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RBSTBACT 

This is an experimental 2-phase study which focuses 
upon perceived respondent burden (PBB) , that is, upon negative 
feelinas which may be experienced by people who participate in 
household surveys* For phase 1 of the study, whose results are 
reported here, the effects of two variables — interview length and 
interview effort — upon PBB were assessed. Length was varied by using 
either a 75 or a 75-minute interview. The "effort" variable was also 
separated into two treatment??, in which some respondents were asked 
to check their records for the answers to household expenditure 
items, and others were asked to provide estimates based on memory. 
Bespondent attitudes were assessed via a self-administered "reaction 
form" which was handed to the respondent at the conclusion of the 
treatment interview. Findings suggest that: (1) persons exposed to 
the lonaer interview were less likely to express willingness to 
participate in future surveys: (2) willinqness to complete the 
interview, item response rates, and self-perceived accuracy of 
responses were not affected by length: and (3) varying the level of 
effort did not affect PBB. (iuthor/PL) 
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SUMMARY 



Thq Study Design and ttii limitation* 

The Mensurernent of Respondent Burden Is en experimental 2-phA9e 
study being conducted For the Department of Housing and UrbNn Development 
by the Bureau of Social Science Research. The study focusses upon per- 
ceived respondent burden, that Is, upon negative feelings which may be 
experienced by people who participate In household surveys. For Phase I 
of the study, whose results are reported here, the effects of two 
vartables--lntervlew length and Interview effort--upon respondent burden 
worrs assessed. Length was varied by using either a 25 or a 7S-mlpute 
IntervJ«5w, The "effort" variable was also separated Into two treatments, 
in which sorie respondents were asked to check their records for the 
answers to household expenditure Items, and others wer4 asked to provide 
estimates based on memory. The two variables were crossed to produce 
four different "treatment" Interviews. Respondent attitudes were assessed 
via a se I f-admlnl stared "reaction form" which was handed to the resporlent 
at the conclusion of th^ treatment Interview. Negative attitudes reported 
through this form as well as Item non-response rates during the treatment 
Interview and interviewer reports of respondent behavior were used as 
Indicators of respondent burden. 

In Phase II, the effect of another treatment —repeat administration 
of Identical interview Instruments of varying length-*-w{ 1 1 be studied. 
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Tho ftudy flndln^t thotjid bo lnt«rpr«t«(l with two fdctom In 

mind: 

I. Tho Intervlowt vmrP conducted In hou«eholdi located In a 
predominantly whi to middle cIaii luburb (of Phi UdolphU) . Thorofor«, 
tho itudy findings may not bo Appllcablo to other populatlont, for 
example, penoni living In rural areas or In Inner cities, or to other 
typos of Interview situations. (In Section Ml of the report, "External 
Validity Issues," we have trJed to address this problem, as far a* our 
data allow, by analyzing the study results for demographic subgroups.) 

2. The treatment Interviews dealt with topics such as housing 
and neighborhood conditions, energy costs, and transportation. The 
results might have been quite different If more (or less) respondent- 
pertinent topics had been discussed. 

Key Findings 

'differenc es Between Res pond ents and Refusers 

• To achieve 500 Interviews a total of 886 household were contacted; in IS** 
cases no contact could be established, and In 202 cases, the householder 
refused to be Interviewed. No attempt was made In this study to convert 
initial refusals, but a brief Interview was conducted with those refusers 
who cooperated (N«l07) . The 202 persons refusing to be Interviewed constl- 
tuted 29 percent of those contacted for the survey. Although respondents 
were younger than refusers, no other significant differences were found 

In terms of demographic characteristics, or for those variables 
which might have affected the Interview situation (I.e.. time of day 
of the attempted Interview, or experience of the Interviewer Involved). 
However, refusers and respondents differed In their general attitudes 
towards the usefulness of surveys, and In their past participation 
In Interview situations, with refusers less likely to rate surveys 
as useful, and less likely to have participated In surveys In the 
rrcent past. 

• While the time required for an Interview was frequently the reason 
given for the refusal, the actual length of time when announced to 
the respondent at the door-I.e., 25 or 75 minutes-did not seem 
to contribute In any appreciable way to the tendency to refuse 

The percu.^tage of refusals occuring after the specific time was 
ment oned was virtually Identical (about m) for both theJong and 
short Interview groups. 
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• Mor«ov«r, tH« InttrvlowoPi ' prior knowltdQa of th« li»nflth of tho 
Intervliw to bt Attempted wAt not r«I«tod to th« ov«p<in p««^ci?nt«gi» 
of rtfuiAll obtalniicl, which was 27 porcont for th« ihort vi. 30 p«p- 
c«nt for th# long form, 



O»nor<il R»Action» to the Survey 

• Among tho 500 parions contenting to bo lnt«rvl«wed, reflctloni to 
th« furvay w«re overwhelmingly poiltlvo. Only two of thete 
rtipofidentf broke off the Interview prior to completion. Lerge 
majorltlei ftit thot tho Interview w«i «t least somewhat Interesting 
(87^) end Important (88%), and that their time and effort were at 
least somewhat well spent (90%). Eighty percent said that they 
would be willing to be rel ntervlewed next year. 



Relationship of Respondent Burden 
to Interview Lenqtii. and ETfbrt 

• Wo relationship war found between Interview leng th and overall 
Item nonresponse. On the average, both the long^nd short 
Interview groups failed to answer only about three percent of tho 
questions they were asked. 

• However, Interview length was associated with willingness to bo 
Interviewed, with \h percent more of tho people given the short 

as opposed to the long Interview stating that they would be willing 
to allovi the Interviewer to return next year. (The actual flguroj^ 
were 87 percent and 73 percent for the two rospec Ive groups.) 

• Interview length also affected attitudes towards the Interview, 
but only to the point of eliciting more negative responses to 
questions which asked specifically about length. The longer 
questionnaire was not seen as being more of an overall nuisance, 
or as being more uninteresting, unimportant, or difficult than 
was the shorter interview. 

• In general. Increasing the effort required to complete the respondent 
task (retrieval of records) had no effect on behavioral or attltudlna 
Indicators of respondent burden. For example, there were no signi- 
ficant differences between the recall and retrlev;>* qroups In Item 
nonresponse rates (which were 2.89% ^nd 2.82% respectively), in 
willingness to be relntervlewed (80% of both groups agreed), or in 
porportlons of respondents within each group who felt that tho Inter- 
view was uninteresting, unimportant, not time well spent, etc. In 
short, asking r.»spondent$ to retrieve records neither created a 
burden (as Is *»ssumed by some researchers) nor Hid It generate a more 
positive reaction by conveying to the respondents the suggestion that 
the survey was very Important. 
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v»rl«ibl||r-f"^l! II, whor> refPorid«ntt woro qroup«d by thi» perc«ntflq« 
of tlfnoi t^^'V ^etualYy ch«cked th«1r r«cordi--no !ilqnlflc«nt rel«tlon- 
<ihlP» b»tw*'*^ effort «r>tj (ndlcAtori of burden w«r« found, However, 
In both th* ''•v:«n «nd t^g record retrlovii' 9roup«, perionf who 
ftihffir fftfd^'"^^ to t^^t**" recerdi «!! cxppwi»»d nirprlvo aetfntd^i 
morfi fr^i^w*''^ V th*n dl^j other retpondentt. Therefore, there nviy 
b« tCMVt^ Af^^^i^tton betwvQH feellngi of burden, unwi 1 1 1 ncjneti to 
oWt ^ffof^^ \ry the Intor^Iew iltuetlon. and detA quality which 
thil p^»rtl^"'^^ ttudy wn, not deilgned to probe. 



lntervlgW^U^_n(^t> Ljfi^ Ry^pgnHe nt purden 
with OtNL f<<( ^tg^*^t>n <tXf'*'^^^ 

• Th« n^lftClt'lJ^^lp betweofi respondent burden <*nd Interview lencjth 

w«i »X«ft)ln*^^lth other varleblcs (both ottltudlndl ond Hemogrrtphic) 
h«ld con^t^'J'J* Hen UiUl^ated lo^^ wMllngnesN to b© rclniorvlov'^ed 
than W0(t»ifn ^|vfl»» the ion9 form, the jicin»e wos true ol employed 
porioni jin<^ those with rnore oducotlon (high school Hlplomo or 

• HowffVesir, th^ *<^y finding emerging from this arwiysis was that a 
g«nffr*l In the efficacy of survey Is on Important factor 
loflu«ncfn^ .^'^^ cKtent to which Interviews of various lengths wMI 
be pftrctjfv^^ burdenso„^^ That Is, among respondents agreeing 
that •'flh^v'*'^ lurvoys |, of dl :t benefit to the people who 
aofWer.'i th^ ["^Ifltlonshlp between length and key Indica ors of 
burdon }^ *^?'^^ned. ^^or exa'^Ple, fo- this group, the percentage 
ref'filno to relntervi^^d was generally low, no matter If th** 
short (8%) the long (io9f) treatment had been applied. In 
contrjBS^, f^^ ^i6ipondent5 ^fho did not agree that surveys ore bene- 
ficial* tHe/^^<itlonshlf> 

between length and burden became much 
stronger. this 9roup, the percents refusing to be relntervlcwed 

were lOper^^f^t for the short and percent for the long interview 
groups (0 d'^^f^rence of 257.). - 




e Based on th^ '^tnltec' "«<isures available In this study, no relation- 
ship was fot'^d ^j^^vycen Interview length and data accuracy (as per- 
ceJvecJ by r^'Pa^^dents a»><j reported In answer to an Item In the 
reaction fo'"^' » or completeness (based on I tern nonresponse to the 
treatment ^''^^'"Vlew) . Contrary to commonly held assumptions, item 
nonrfisponso ^'^ not incr^gje during the course of the long Interview; 
Inco^T^e qucs^'^h^ asked (he beginning and end of that Interview 
elicited a ^^^t^rablc r^vi^jively high level of nonresponse. 




• SlwMrtrly, no Q0n*r«l rplftt lonnhlo bptw^mn record ch<>cMna «m1 
(lAt4 quality WA» found, AUhouQh, on ihp AV^r^o^* mtrlvv^l 
r©iponH«ntt did refer to recjordt more frequently thrtn those 
diked to rely on moiwry, dlfferencen In per elved flccurflcy of 
reironie between the two qroupi, while In the eJ<pected direction, 
were not sfflt ft ttcalty iitqntfic«nr. Only nmonq p^^J'soni fflvorflhly 
prerUpoied toward turveyfi, did a ilqnl f Icdnt ly greater proportion 
of retrieval th«n of recflll reipondent» ptrcelvo their renponfte* 
fl» ' ^ery ^^cciiroto/* 

Th« findings obtdlnod to date i^uggo&t th«t varylny tho level of 
otfdrt entrtllcd by my Interview <is oper^t I on«i 1 1 /ed for thU %tudy (lao% 
not .iffect self -perceived re*ipondent burdei\, They ,iUo Nuggent that tho 
jUclosed length of vin Interview dor* '^Ot effect rcfu^^l decisions. 

Pcrnonn exposed to the longer Interview were ler»s likely to cxprc%^ 
wMllrujne*.^ to pdrtlclpato In future surveys., sugyevtlr»g Indeed some 
relationship between lenglti and sel f -percet ved burden. ThU finding will 
be emplrlcolly tested In Phase II of the study. Willingness to complete 

'^e Interview, Item response rc»tcs, and ^e 1 f -perce 1 ved accuracy of 
re5pon»ie5 were not oftected by length, nor was the generally l\worable 
assessment of the Interview. 

Belief In the efficacy of surveys clearly emerged as an Important 
element affecting feelings of burden, perhaps even overshadowing actual 
Interview length. This finding suggests that to reduce se I f -perce I ved 
burdi'n in long Interviews, It is most Important to convey to the respon- 
dent the Importance and usefulness of the survey method and the likeli- 
hood that the survey data will In fact be used by the research sponsors. 
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I . BACKGROUND OF THE STUDY 



I ntroductlon 



This report describes Phase I of the Measurement of Respondent 
Burden, an experimental study cciT"!ucted by the Bureau of Social Science 
Research for the Department of Housing and Urban Development. The 
focus of the study is upon correlates of self perceived respondent burden 
that is factors associated with the presence of negative feelings such 
as annoyance, frustration or inconvenience which may be experienced by 
survey participants. The study Is limited to survey situations In which 
face-to-face Interviews are conducted In respondents' homes. 

The issues addressed by this research are of interest to HUD 
in connection with its sponsorship of the Annual Housing Survey (AHS) , 
a face- to-f nee household survey which is the primary source of informa- 
tion about the condition of the nation's housing supply. The level of 
refusal rates Tn the AHS, reports from field observers, and occa- 
sional complaints by Individual respondents tave caused concern 
within HUD with the burden which the survey may be Imposing upon AHS 
respondents . 

The issue of respondent, burden is also of interest to a wider 
audience of survey and evaluation researchers, who are concerned with 
maintaining or improving response rates In their data collection 
activities, and to government personne* charged with managing or regula- 
ting Federally-sponsored data collect on efforts. The present research 
Is intended to provide information wf.lch will be useful both to HUD staff 
and to this broader research community. 
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Cofpmon Assumptions About Respondent Burden 



According to the Report of the Commission on Federal Paperwork, 
"individuals complete well over 500 million Federal forms each year on 
matters related to their personal lives." If we define "paperwork" in 
its broadest sense to include personal interviews, we can argue that 
the Annual Housing Survey certainly contributes to this load; to carry 
out the survey. Census interviewers conduct approximately l80,000 inter- 
views yearly. 

Limiting the number of information requests which may be 
sponsored by Federal agencies is a function carried out, in part, by 
the Office of Management and Budget (0MB). OMB*s guidelines require 
that special consideration be "given to the burden on individuals. . ." 

and that "individuals . . . should not be called upon to spend more than 

2 

one-half hour in responding to a request . . . ." Activities requiring, on 
on the average, more than one-half hour of response time per person must 
be explained by a "special justification" before an 0MB clearance 
allowing the activity to be fielded will be granted. Implicit in this 
procedure is the assumption that "less is better," 5.e., that long 
interviews will overly burden respondents. 

This same assumption surfaces again in suggestions which have 
been made for revisions to the Annual Housing Survey. At an invita- 
tional conference convened during January, 1978, several possible causes 
of respondent burden in the AHS were identified, among them interview 
length. Consideration of this factor led to suggestions that the AHS 

^ A Report of the Commission on Federal Paperwork; Final 
Summary Report , Washington, O.C., 1977, p. 64. 

Office of Management and Budget. Federal Statistics : 
Coordination, Standards, Guidelines . Washington, O.C.: GPO, 1976, 
p. 46. ~~ 

is 
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be redesigned by shortening the questionnaire through the use of core 
questions (to be administered yearly) and of rotating supplements (to 
be administered on a less frequent basis.) 

A second factor flagged as a possible cause of burden for AHS 
respondents is the panel design of the study. The Annual Housing Survey 
consists of two parts; a national longitudinal survey in which occupants 
of a nationwide sample of housing units are interviewed each year, 
and an SMSA longitudinal survey, in which occupants of housing units in 
selected metropolitan areas are interviewed once every four years, A 
recent review of the fixed panel design feature of the AHS concluded 
that a rotating design would not necessarily lower refusal rates. 
Despite this conclusion, however, the review went on to state that 
"additional research should be done to examine other reasons for rotating 
the survey, i.e., whether the respondent burden needs to be spread 
among a larger portion of the population ." [Emphasis added.] 
It was thus assumed that there is some relationship between frequency 
of being interviewed and perceived respondent burden. 

The basic stimulus for the research described in this 
report is that the assumptions outlined above are based primarily on 
intuition. Few empirical studies have been done exploring the relation- 
ship of interview isngth and frequency of interview to perceived burden. 
This conclusion is based both on a formal literature review conducted 
as part of th;s project, and upjn our contacts with approximately kS 

prominent survey research organizations from whom we requested unpublished 
3 

Malmuth, M. The Advantages and Disadvantages of Rotating the 
Annual Housing Survey, National Sample from a Non-Response Point of 
View . Paper presented at the American Statistical Association Annual 
. Meeting, Aug,, 1978, p. 26. 
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work In this area. We found that much of the literature, both published 
and unpublished, has focussed on data quality or response rates, not on 
perceived burden. Further, much of the tangential 1y related work has 
treated Independent variables outside of the scope of the present 
project, such as promises of confidentiality, use of incentives, etc. 
Finally, most of the studies Involving the length variable have been 
limited to mall or phone questionnaires. 

Although It Is thus without strong empirical underpinnings, our 
understanding of the topic of respondent burden does have a theoretical 
basis. A ^'theory of respondent burden" has been presented by Norman 
Bradburn, director of the National Opinion Research Center (NORC) 
Bradburn's theory targets four factors which maybe related to per- 
ceived burden on the part of respondents; Interview length, required 
respondent effort, frequency of being interviewed, and the stress of 
psychologically disturbing questions which may be asked. The theory 
suggests that length, effort, or frequency of being interviewed do not 
by themselves constitute a burden; burdensomeness Is the product -f an 
Interaction between the nature of the task and the way In which It Is 
perceived by the respondent. Thus, by enhancing the Importance of the 
study for the respondent, longer Interviews may even result Tn a 

Much of this work is summarized In Marquis, K. Survey Response 
Rates: Some Trends, Causes, and Correlates . Health Survey Research 
Methods: Second Biennial Conference, Williamsburg, Va., May 4-6, 1977. 
DHEW Pub. (PHS) 79-3207, 1979. Other useful references in the general' 
topic of survey nonresponse are: Hawkins, D, A Bibliography of Studies 
of Non-Response in Survey Research . UNC, Chapel Hill: Institute for 
Research on Social Science, I978, and Nonresponse and Characteristics 
of Non-Respondents , Washington, D.C.: Bureau of the Census, undated 
SMIS Bib) iography. 

^Bradburn, N. Respondent Burden. Health Survey Research 
Metho^. DHEW Publication No. PHS 79-3207, I97«, PP. 49-53. See also 
Sudman, S. and Bradburn, N. Response Effects In Surveys : Chicago, 
Illinois: Aldlne Publ ishlng Co., 1974. 
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reduction In perceived burden. Questions requiring some special effort 
on the part of respondents— such as asking them to check records for 
expenditure data— inay serve a similar function. 

To test the latter assertion, and to examine Interactions between 
IntervJew length and Interview situations requiring special effort, "record- 
checklng*' was Included as a variable In the present research effort. 

Coincidental )y, the one empirical study most directly related 
to the topic of respondent burden also comes from NORC,^ The study 



Is relevant because, unlike others, it does focus directly upon per- 
ceived bu*'den, albeit among a rather select population, farmers asked 
to participate in USOA crop and livestock surveys. The principal 
findings of the NORC researchers do not support the commonly accepted 
truisms. The researchers concluded that actual interview length, or 
frequency of interview are poor predictors of perceived burden. As 
stated in their report: 

In their assessment of survey burden, farmers and ranchers 
are not so much influenced by the number or length or type of 
surveys as they are by their perception of the quality of the 
surveys and the effects of surveys upon their lives. Operators 
who are convinced that surveys produce useful and accurate 
information that serves primarily their own economic interests 
tend not to feel burdened by even large number of surveys. Those 
who are not so convinced are likely to feel that even one survey 
request is too many, (p, 69) 

Clearly, then, the commonly accepted assumptions about 

respondent burden required some further exploration. 



Jones C, et al . Dakota Farme r s and Ranchers Evaluate Crop 
and Livestock Surveys . Chicago, Illinois: National Opinion Research 
Center, 1979. 




IK DESCRIPTION OF THE EXPERIMENT 
The Study Desf qn 

The respondent burden study Is being implemented in two phases. 
During the first phase of the experiment, bcth Interview length and 
the effort required of the respondent to answer certain questions were 
manipulated, and their effect upon perceived burden assessed. Length 
was operationally defined as ''number of minutes of interview time," 
with V.S and 75-minute treatments used. The "effort" variable was also 
separated Into two treatments: recall, in which respondents were asked 
to provide estimates based on memory for answers to selected expen- 
diture questions, and retrieval, in which respondents were asked to 
consult checkbooks or other records to answer these questions. 

The length and effort variables were crossed to create four 
treatment groups, each of which received a different version of the 
interview: a short recall Interview (Group 1), a long recall inter- 
view (Group 2), and short and long retrieval Interviews (Groups 3 and 
(See Figure I .) 

Respondent burden was measured by direct questioning of the 
respondent through a self-administered reaction form, which was given 
at the conclusion of each "treatment" Interviewl (For 100 of the 
respondents in Group 1 and 100 Tn Group 2, the reaction form was not 
used, since these respondents will be reintervlewed for the second 
phase of the study.) Respondent burden was also behavioral ly 
assessed by examining various types of response rates among treatment 
groups. 



19 



FIGURE I 
STUDY DESIGN 





Group 1 


Group 2 


Group 3 


Group k 


25 Minute Instrument, 
Recall Effort Only 


75 HInute Instrument, 
Recall Effort 


25 HInute Instrument, 
Record Retrieval 
Required 


75 HInute Instrumei 
Record Retrieval 
Reqiilred 


Group lA 


Group IB 


Group 2A 


Group 2B 




75 


100 


75 


100 




75 


Phase 1 Interview 


✓ 


✓ 


/ 




✓ 


/ 


Phase 1 Debriefing 


✓ 










/ 


Phase II Interview 




✓ 




✓ 






Phase II Debriefing 




/ 




✓ 







For the second phase of the study, the effort variable will 



be eliminated, and the third manipulated vari abl'^^^-si ngle vs. repeat 
administration of identical questions over time— will be introduced. 
The "repeat" treatment will be applied approximately nine months 
after the first data collection cycle (i.e., in November, T980) by 
conducting a second round of interviews with a portion of the Phase I 
sample. The effects of the "administration" variable wi 1 1 be assessed 
by comparing the single administration groups (Groups 1A and 2A in 
Figure i) and the repeat administration groups (Groups IB and 2B) in 
terms of overall nonresponse rates and by comparing their responses to 
the reaction form. 



The interviews were conducted in the suburban area of Phila- 
delphia; field work was subcontracted to the institute of Survey 
Research, Temple University. The study area can be characterized as 



A multi-stage sampling procedure was used to select respondents 
from this area. At the first stage, 50 clusters of 12 households and 
25 clusters of I6 households were randomly selected from all clusters 
in the suburbs of interest; clusters were formed by grouping adjacent 
addresses in the Coles City Directory. For each selected cluster, a 
lister was sent to the field to obtain a complete and up-to-date 
listing of households. 

At the second stage of sampling, subsets of six households 
within the clusters of 12 and subsets of eight houi>eholds within the 
clusters of T6 were selected for a total of 500 households (50 x 6 plus 
25 X 8). The remaining subsets were held in reserve to be used as 



Sampling Procedures 



relatively prosperous and predominantly white. 




substitutes che origlpgi households In the event that an Interview 
could not °^;:eifted. 1^ ad<lltion, 15 "reserve" clusters were also 
selected to Used In c^se additional substitutes were needed. 

/\t t^^ ^Inal stag^ sarrpHng, one respondent '^knowledgeable 
abo*Jt hou$ch^'^ texpendltures" was selected at each household. A 
treatfnent wa^ ^^^igned to each selected respondent, and within each 
cluster all ^''^^tments w^re used. In tha^ way, the full experiment 
was repHcat^^ 1 every cluster. 

Questionnaire Oeslqn 

All ^^'"sjons of the treatment questionnaires Incorporate 
selected jtc»f^ ^bom the Annual Housing Survey- For the longer instru- 
ment, additi^'"^' items were created or adapted from other sources to 
achieve the ^^*'^ed Interyigy^ length. The questionnaires were arranged 
In segn>ent5 ^^pic area, ^ith "stop polats" at the end of each segment 
Instrucrin^ interviewer to end the Interview If 25 (or 75) minutes 
had eUpSftd. ^'^^ topics Included In the short and long forms are 
shown 1 n TigO^^ » | . 

Every *^^ort was n\Qf^e to Iceep the interest level constant between 
the short and ^or\g Instrutn^nts. A mix of open and closed questions was 
Included !„ e^^h. Equivalency of interest was assessed by bSSR staff 
who rated eacf* Suj^^gj-tlon g| i versions of the questionnaire on a 
five-point "I'^^^i^est" scale. No appreciable differences in Interest 
level Were fot'"^. 
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FIGURE II 

TOPIC AREAS INCLUDED IN TREATMENT QUESTIONNAIRES^ 



Area 



Questionnaire Type 



Short 



Long 



Household co(nposition/cienx>9raphic Information^. . 

General Information about house/apartment^. . . . 

Energy-related questions (household heating, 
cooling^ Insulation^ etc.) 



Household repairs 

Electrical appliances, use of electricity, 
electricity bllls° 

Other fuel, bills*' 



Neighborhood services 



Neighborhood crime. 



Description of neighbors (race» education* social 
Interaction) 



Previous residences 

Transportation: number and types of vehicles owned. 

Transportation: gas purchases* attitudes toward 
shortages 



Transportation: mctho'^ used to get to work**. 
Specific sources of household income^ . . . . 



Yes 
Yes 

Yes 
No 

Yes 
Yes 
Yes 
No 

No 

Yes 

Yes 

Yes 

No 

Yes 



Yes 
Yes 

Yes 
Yes 

Yes 
Yes 
Yes 
Yes 

Yes 
Yes 
Yes 

Yes 
Yes 
Yes 



^For most topic areas, the longer questionnaire contained more Items 
than did the short one. Recall and retrieval versions of the Instrument were 
Identical, except that different versions of expend I tu res Items were used. 

^Indicates topic areas Included In past or present versions of the 
Annual Housing Surveys, or proposed for AHS use. Most questions within these 
areas were taken verbatim or adapted from the AHS; In some cases additional 
non-AHS Items were used to achieve the desired interview length. 
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The reaction form, adnfifnlstercd at the conclusion of the treat- 
ment Interview, contains I terns used In earlier studies of Interview 
participants as well as some especially created for the present effort. 
A telephone questionnaire to obtain Information about persons refusing 
to be Interviewed was also developed. 

All data collection Instruments were pretested In a Northern 
Virginia suburb of Washington, O.C. 



The study's data collection procedures were patterned after 
those used In the Annual Housing Survey. As in the AHS, an advance 
letter was sent to each of the 500 "original" households selected for 
participation In the study. The letter described the general subject 
matter to be covered and informed respondents that the results would 
be used to improve the design of the Annual Housing Survey. Respondents 
were further informed that their participation was voluntary, and that 
the results would be reported In aggregate form only. The fact that 
respondents would be asked to complete a reaction form at the conclusion 
of the interview was not revealed to them either in the letter or during 
the interview. 

Up to four call-backs were allowed at each household to complete 
an interview wl th a respondent "knowledgeable about household finances." 
Several restrictions were placed on the timing of calls: the first 
attempt had to be made after 3 P.M. on a weekday, or at a reasonable 
weekend time; If other attempts were necessary, at least one call had 
to be made on a weekend or after 6 P.M. on a weekday. If, after four 
calls, an Interview was not obtained, the interviewer was given a sub- 
stitute ass I gnment at which to administer the selected treatment. 



Data Collection Procedures 




Upon arriving at the household, the lntervie%«r read an Intro- 
duction In which she repeated the confidentiality provision and told 
the respondent how long the Interview would last. Reaction forms were 
handed to all persons consenting to the lntervlew--except those 
targeted for Phase H of the study— at the conclusion of each session. 
Interviewers were Instructed not to assist the respondent In completing 
this form. The respondent was Instructed to seal the envelope containing 
the form and to give It to the Interviewer. The option of mailing It 
directly to the survey organization was also available. As detailed In 
the next section of this report, a special effort was made to follow up 
those persons refusing to be Interviewed, so thct the reason for the 
refusal could be determined. 



Ml. PHASE I KESULTS 

• 

Th« msuUs of Phase I of tb« •Mp^rlmnt ar« pr«s«ot«d In urm 
of stv«ral Mjor rtstarch qutfstlofit: 

1, How do furv«y r«spond«nts and ffufrs diffar? 

Z, I ^In9 at tha raspondants only, can t#a datact a ralatlon- 
ship batwaan tha langth of tha tntarvlaM and tha burdan parcaivad by 
tha parsons Intarvla%«ad7 SiMlUrly, Is thara an association bat%«aan 
tha effort required In tha Interview situation and tha parcaivad burden? 

3. Under what conditions do tha observed relationships ^pp^^r 
to '•hold up?* 

In addition, tha final part of this section looks at Issues of 
dete quality and flegs specific questions reported as problems by study 
respondents. 

A technical note on the validity of the findings to be 
reported Is epproprlete hare. Strictly speeking. In analyzing tha 
dete, we w? 11 be operating a t the level of what Cook and Campbell^ have 
called '^statistical conclusion validity/' That Is, we will be looking 
at Interview length, effort, and perceived burd^ as ooerattonaHy 
defined and n<>asurad In this axperlwent to determine If length (or effort) 
and tha Indicators of burden are statistically asfoclatad. In looking 
for associations. It will also be Inportant to determine If there are 
consistencies across the various Indicators of burden, so that tfu. 
specific elements of respondent burden related to length or effort may 
be pinpointed, 

- rr:^ 

^Cook, T. and Campbell, 0. Quasi - Experimentation Design and 
Analysis issues for Field Settings , Chicago, Illinois: Rand McNally, 
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If any significant associations are observed, we must look for 
alternative explanations (I.e., ways In which the experimental groups 
differ other than in the length or effort of the Interview situation) 
to explain the observed relationships. If no alternatives a: found, 
the "internal validity" of the experiment— 1 ,e, , the plausibility of 
inferring that* length or effort and perceived burden as we have defined 
and measured them are causally related— is strengthened. Finally, to 
increase the "external validity" of the experiment— I .e. , the extent 
to which its findings can be generalized to different settings, types 
of people, historical times, etc. --it will be Important both to 
determine the extent to which any results we find hold up for specific 
subgroups of respondents within this study, and to compare our findings 
with other research along these lines which has been done or may be 
done In the future. 

Factors Affecting Vlliinqness to Respond ; 
A Comparison of Respondents and Refusers 

To complete the required number of interviews, interviewers 
entered a total of 80 clusters and attempted contact at 886 addresses. 
Seventy percent of the attempted interviews took place during the day, 
and 26 percent during the evening (after 5 P.M.). Fifty-eight percent 
were done on weekdays and ^0 percent on weekends or during a February 
holiday. Thirty-three Interviewers were used, 2k of whom had more than 
one year of Interviewing experience. Altogether kSB interviews were 
actually completed. (See Table I for a summary of the field work effort 
and its results.) 
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TABLE I 

SUMMARY OF FIELD WORK EFFORT AND FINAL 



SULTS 




A. Type of Address Used ^jo5) 

Original address ^j^) 

Substitute address* ^3) Ijj 

UnVnoWii q 

B. Day of Attempted Interview ^ ^j50) 
Weekend/hol Iday ^j2l) 40 

^•^'^^^y (15) 58 

Not determined 2 

Ct Time of Attempted Interview ^ (6^0 ) 

Day (up to 5:00 pro) ^^jo) 7O 

Evening (5:00 pr and later) ^ jg) 26 

Not determined ^ 

r . Final Interview Result q2 ) 

Cpptact made ^ 

Completed Interview ^^q2) 56 

'Refusal ^2) y 

Breakoff ^ 0 

No contact made 2l 

Language barrier ^ ^3) | 

Could not contact after 4 calls ^ jg) |q 

Eligible respondent away 2 

Vacant ^ 4 

Not a housing unit ... 2 

Other 2 

-^^5^6) 

Total (N) of Addresses Used ""\^O0 

^j^^tcrs. J""-^"-^ — 
^Twenty of these addrcssiss were from reserve ^.^(\ the orj^^ 

remainder were obtained from subtstltute households ^^IW 
sampled clusters. 

b attempt 
Refers to day and time in which final IntcrV 

made. 
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Since one of the motives underlying the concern with respondent 
burden Is Its presumed connection with refusal decisions. It Is Important 
In a study of this phenomenon to !ool< for characteristics which distinguish 
respondents and refusers, and to establish the exact circumstances under 
which the refusal occured. An understanding of the differences In char- 
actorlftlcs of these two groups also yields Important clues to the biases 
In data that may result from refusals. The refusal rate for this survey 
was 23 percent of all addresses (N»886) , or 29 percent of all ''good 
addresses" (N«702) , I.e., those which were occupied by surveyed iglble 
residents, so that an Interview could have taken place.® These refusal 
rates are somewhat higher than rates experienced In other household 
surveys. However, the refusal rate may have been Inflated by the data 
collection procedures which were used to mset a rigid deallne.^ If 
Interviewers encountered a refusal, an Ineligible respondent, etc., 
they were provided with substitute assignments. This practice may have 
encouraged them to accept refusals more readily than Is usually the case. 
Also, we did not. In this survey, follow the common practice of attempting 
to "convert" refusers via telephone follow-up calls. 

®ln some cases, the distinction between refusals and Ineligible 
respondents Is not clear-cut. Twelve households were classified as 
Ineligible because the interviewer was unable to communicate Initially 
with the resident ("language barrier"). In a few other cases, the resident 
claimed that he did not want to participate because he was sick, barely 
spoke English etc.; these were classified as refusals. 

^AII Interviews need to be completed In one month so that, in 
accordance with 0MB regulations, no field work would take place during a 
^-month period surrounding the 1980 census. 
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Data on refusars was obtained by asking Intorvlowors to code the 
sex and approximate age of the refuser and the point at which the refusal 
took place. Supervisors then attempted to administer a short refuser 
follow-up questionnaire by phone for the 135 cases for which phone, 
numbers were found. Contact was actually established with 115 of 
these Individuals; eight couid not be Interviewed because of a lan- 
guage barrier, 48 terminated the Interview after the first or second 
question, and only 59 went through the entire sequence of questions. 
Therefore, much of the Information available to describe refusers Is 
based on a small number of individuals. 

Three types of data distinguishing respondents and refusers 
are presented In the tables: demographic characteristics (Table 2); 
past experience with and general attitudes towards surveys (Tab)es 3 
and 4); and characteristics of the interview situation Itself (Table 5). 
(Complete responses to the refuser follow-up form are shown in Appendix A.) 

Significant differences between the two groups were found for 
age (p. < 05) , past experience with surveys (p. <.00l) and attitudes 
towards surveys (with p. 's ranging from<^-OI to 001 depending upon 
the attitude measure used). Respondents were younger than refusers; 
a greater proportion reported participating In surveys in the past; and 
they had more positive attitudes towards surveys in general. The differ- 
ence In attitudes between the groups Is evident both for several of the 
specific Items used as attitudlnal measures (as shown In Table 3) and 
for the overall attitude score created when the Items were combined into 
an Index (shown In Table k) . 



TABLE 2 



CHARACTERISTICS OF RESPONDENTS AND REFUSERS: DEMOGRAPHIC VARIABLES 



Rtspondent) 

(H) % 


Refusers 

(N) i 


TOTAL 
(N) % 


1 • • * 1 « ( « • 1 1 « 


. (179) 


36 


m 


Ik 


m) 


36 


nder W , . 


(210) 




(61) 


33 


(271) 


i(0 


ccupatlonal status 














Full-tlmfl worker 


(217) 




(22) 




(2I*0) 


kk 


Part-time worker 


(75) 


15 


(3) 


5 


(78) 


\k 


Homeinaker 


m 


27 


(19) 




(153) 


28 


Retired, , , , , 




8 


(9) 


16 


(50) 


9 




( 28) 


6 


(2) 


k 


(30) 


5 



*P < .05. 
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TAILI ) 

CMAMCTIHI8TICS OF MESPONDCNTS VS. KCFUSCKSt MST rXFCKICNCC 
WITH AND AHITUOeS TOWAKD SUKVCYS IN QCNCKAL 



Chartcttrtitle 



Nuni6«r lUlpondtng 
HIiitng Caies 
Tot«t (N) 



Mipondcnti 

(N) % 



NrtklNttd In • iurv«y during th« 
INiiK 12 month! , . (103)** 37 

Itrongly tgrtcd or tgrMd with 
th« following ittttminti cbout 
tfurvoytt 

Pwltiv Statiwnti 

Aniwitring turvtyi li of dtrtct 
bttntflt to th« poopU who 

•ntwari (15I1) 58 

Toking part In lurvoyi oin givo 
m • chanco to tolk obout 

Intoroiting toplci (I7<t) 66 

ly toking part In turvoyi I can 

affact tha govarnmantU 
' dacliloni (160) 60 

Tha most Important way to 
tmprova tha quality of Ufa 
In Amarlca It by taking 

lurvayi fraquantly (|(i7) 5I1 

Nagatlva Statawwntt 

Too many lurvayi ara baing 
conductad thaia dayt ( 95) 36 

Survayi aik quaitroni that ara ^ 
too parfonal ( 86)** 31 



(J63-J77) 
(19-33) 
(296)» 



Mfuiari 

(N) X 



(8) 



(26) 52 

(22) k$ 
(22) 

(16) 38 



(39) 
(35) 



78 
73 



(»t2.7't) 
(33-65) 
(107)^ 



TOTAL 
(H) % 



(207) 60 



(IBO) 57 

(196) 63 

(182) 58 

(163) 52 

(I3M *»3 

(121) 38 



*P <.0I. 



P <.00l. 



*296 li tha nunbar of paopla raspondtng to tha raactlon form. 

^107 U tha ..iiflibar of persons answering at least tha first question on the refuser form. 
59 paopla went through tha entire refuser follow-up Interview. 
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TABLE 

MEAN "NEGATIVE ATTITUDE TOWARD SURVEYS'^ SCORE OF RESPONDENTS VS, REFUSERS 



Standard 2*Tal)ed 
Mean Deviation T Value Probability 



People Answering the Entire 
"Attitude" Ouestton 

Respondents 



People Answering One or More 
Parts of the Dues t Ion 

Respondents , , , , 

R«fu»ers 



(28) 



(279) 
(59) 



1.86 
3.25 



1.77 
2.52 



t.56 
I. '♦3 



1.53 



.000 



.001 




The negative attitude toward surveys scale m computed by counting the number of tinies perioni 
agreed or strongly agreed with negative statements about surveys (e.g., "Too many surveys are being conducted 
these days) and the number of times they disagreed or strongly disagreed with positive stateflier.ts (e.g.. 
Answering surveys Is of direct benefit to people who answer"). Statements a-e In Q. 5 of the reaction form 
were used In constructing the scale. Scores could range from 0 (no negative attitudes expressed) to 5 (five 
negative attitudes expressed), ' ^\ 
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TABU 5 



CHAHACTERISTICS OF RESPONDENTS VS. REFUSERSi VARIABLES 
RELATED TO THE INTERVIEW SITUATION 



Reipondanti 

(N) % 


Rafusiri 

(N) % 


TOTAL 
(N) % 


Tiro Intarvlflw wai Attemptid 














DAytlnWt » 1 • 4 1 


(361) 


Ik 


(133) 


69 


(W) 


72 


Evining 


(130) 


26 


(60) 


31 


(190) 


28 


Day Intarvlaw was AttaniDtad 














Waakand/hol tday 


(193) 


39 


(81) 


k\ 


m 


39 


|i/Bakday« • • « • t ■ i ■ • ■ ■ ■ 


(305) 


61 


016) 


59 


m 


6t 


Exparlenca of Interviewer 














Inexperienced. . 


(93) 


19 


(^2) 


21 


(135) 


19 


Experienced 


(^♦05) 


81 


(160) 


79 


(565) 


81 



Total (N) of cases for 
which Information wns 

available (i*9l-W) (193-202) 

Missing cases (i)-/) (0-9) 

Total (N) (it98) (202) 
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It If al90 Informative to nota wayi |p which tha two grovipi do 
jij^ dlffar. Mo iilg.il f leant dlffarancai war© found In tarmt of sax, or 
occupational ttot'»«, o- for thoia varlablas which wa usad to daicrlba 
tha Intarvlaw n'txiatlrn, i.e., tino or day of thcj ottemptad Intarvlaw, 
or exparlenca cf thvi Intarvlewar Involved Table :;). This latter finding 
was unexpected ilnce wa had hypothec rxed that a larger proportion of 
refusers than respondents would have ancountared Inexperienced Interviewers. 

An examination of the reasons mentioned by refusers for declining 
the Interview does rot provide a clearcut Indication that time require- 
ments, from the point of view of the respondent, are a major factor 
(Table 6). While one-fifth of the refusers said that the I nterv lew would 
take too much time, the actual time raqui red-. | , 25 vs. mlnutes--dld 
not seem to contribute In any appreciable way to the tendency to refuse. 
The percentage of refusals occuring a^fter the specific Interview length 
was mentioned (as opposed to refusals occuring earlier during the Intro- 
duction) Is virtually Identical for both the long and short questionnaire 
forms (38.1 and y/A percent respectively). 1 1 may be that any amount of 
time Is *'too much" for socneone who Is not predisposed to participate In 
an Interview, or that basing one's refusal on lack of time Is a convenient 
explanation. 

We thought It possible that "time'* might also be Important from 
the point of view of the Interviewer, that Is, that her a priori knowledge 
of the length of the Interview to be completed vnlght subtly Influence, 
her behavior toward the respondent. For example, we hypothesized that 
Interviewers who encountered difficult respondents might be less 
persistent when they knew they would have to administer the long form. 
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TABLE 6 

REASONS MENTIONED BY REFUSERS FOR OECLtNINQ 
TO PARTICIPATE IN INTERVIEW 



Rmioo (N) %• 



lnt«rvl«w would take too much time, respondent 

wei too buiy (2i«) 2 1 

Couldn't do Interview (too old, ilck, Unguege 

barrier, death In family, other pertonal problems) , , (21) 18 

Dldn*t went to be bothered, didn't feel like It, 

not Interested (2l) |8 

Didn't want privacy Invaded, didn't want to divulge 

Information (10) 9 

Time was Inconvenient (9) 8 

Didn't want to take part, participate In surveys .... (9) 8 

Felt that surveys are disguised sales pitches (5) i» 

Disapproved of Interviewer behavior ( 3 

Sponsorship of survey (3) 3 

Nothing to say, couldn't answer (2) 2 

Didn't feel survey would be useful (I) 1 

Other reason, or reason not determined (10) 9 



'Percents based on 113 refusers for whom some Initial contact was made 
(I.e., phone number were found and someone answered the phone). Multiple 
responses were allowed. 
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But th« Information shown In Table 7 lug9«iti that thli hypothaili li 
not trua; 30 parcant of tha good addraiiai with long aiilgnmanti raiultaJ 
In rofuiall, vi. 27 parcant for tha short form. Thaia data luggast that 
a prlof^l knowladga of Intarvlaw length did not have an rppraclabic effect 
upon Interviewer behavior, and, thus, upon response rates. 

Finally, to check for other subtle uncoded differences In Inter- 
viewer behavior which might be related to refusal rates, the percent of 
cases handled by each Interviewer which resulted In refusals was tabulated 
(Table 8). The mode Is between 21 to 30, an Interval which Includes the 
overall percentage of oil cases resulting In refusals (23% as shown earlier 
In Table I). Moreover, no Interviewer accounted for more than 8 percent 
of the 202 refusals. With these facts In hand. It seems safe to conclude 
that Interviewer differences are not an Important factor In understanding 
refusals . 

The findings from this experiment are consistent with other research 
that has been done on the characteristics of refusers. For example, 
Wiseman,'^ In a paper presented at the 1980 annual meeting of the American 
Association 'or Public Opinion Research (AAPOR), showed converging findings 
from his own and earlier studies which Indicated that refusers tend to be 
older than respondents and socially less active and more Isolated. It 
Is worth noting, however, that our findings do not support the hypothesis 
occasionally advanced by survey researchers .that refusers are persons 
who suffer from survey fatigue because chey have been Interviewed too 
many times In the recent past. 

'^Wiseman, F. The Nonresponse Problem In Consumer Surveys . 
Unpublished paper presented at the annual meeting of the American 
Association of Public Opinion Research, Cincinnati, Ohio, I98O. 
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TAILC 7 

FINAL SURVEY RESULTS OY LENGTH OF INTENDED INTERVIEW 





Short 


Long 




(N) 


% 


(N) 


% 




(250) 


58 


(2m 


55 




( 9^) 


22 


(108) 


2k 




( 0) 


0 


{ 2) 


0 




( 9) 


2 


{ 3) 


1 


Could not contact nfter <4 calls .... . 


( 50) 


12 


( W 


10 




( 6) 


1 


( 10) 


2 




( 17) 




( 17) 






( 5) 


1 


( 9) 


2 




( 2) 


1 


( 13) 


3 


Total N of Addresses Used 


(^33) 


100 


('♦53) 


100 


Refusals as a Percent of All 
Addresses 




22 




2k 


Total N of *'Good" Addresses 


(3W*) 




(358) 




Refusals as a Percent of "Good" 
Addresses 




27 




30 



'"Good addresses" are addresses where an Interview could have been 
obtained, l,c.» the first three c.-^ r<^ior les In the table. 
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TABIC 8 

OI$TRiaUTION OP INTIUVIIWEM SY PEHCENTACI OF THEIH ASSICNMtNTS 

WHICH nesuiTeo in RcrusAis 



P«rc«nt«9« of Attlgnm«ntt 
R«tultln9 In Mfutalt 



lnt«rvl«»w«rt 
(N) % 



0 p«rc«nt. . . . 
t - 10 p«rc«nt . 
11 - 20 ptrc«nt. 
21 - 30 parc«nt. 
31 - p«rc«nt 
41 • 50 percent. 
51 percent . . 



(0) 
(6) 
(8) 
(12) 
(M 
(2) 



0 
18 

36 
12 
6 
3 



Total 



(33) 100 



*ThU fntervfew«r was givon only one assignment which resulted 
In a refusal . 



3.9 



perform In iN count iNi InturvlM Mvip « fi|i^«M%^ |ih«i 

on b«l«n€o« th« •«i»«rUnc# initial ^ « |ioiUlv# oa«« iktni^t \Hi^f^\pm 

mlfht tM Afl i»njoy«t»U tnt«rtNirftorf«l ««^rl»nc«, #a o^^tiOf mtfi ly 

noM Inilghti or iMrn About nmt iirodiKU or t«k>4»f, or « io^f«» «if 9«'4Mrt- 

c«tton iKic^ulo Iht rt«pond«nl fmrfomt m nMrulitu Tn« i^^t^t««i 

of our ttudy m«i to tK« to«y In Mhk^ rm^ftv^ ^%MI^ ^»iiUn^t^ 

•bout fturvty |9«rtlclp«tloo «r« «ff»ct»il by cKurA^t^ri iNi i«»f<sf 

vlow (**th« tfo«tffi«nt**) «mf to (Mkii Ju49>nont« ubidwf fN» tdf#t 

undor v«r|out tro«liNint condictoni, whUh mi^HX «n#bt«i ui titur^M 

th« OMptrUnco •! h«vln9 v«rlou« d«9r««i of burU#nikOM«n«%» or «n]oy«*#itl. 

To mt«Buro rttpondtntt* fttolln^t during tK« Inttrvl^w* m i^iirioM% 

Indicators tultsblo for •^lnl»lr«tlon In 4 lur^* ic«)« fwr^y. 7h)<« 

Mjor typoi of IndVcatort Mor« •Ji«mtn«d: 

• Ovort b«h«vlor«l Indicator!, Including InttrvltM br««^«offik, 
tb« p«rc«nt of «ppnc«bic qu^itfont ^hkh tmnt itfr^mttpretS 
by tKo rttpondtnt durInQ tK« ^^tr^^itrnvnt** tnt«rvi«w, 4iA(f 
rsportt from Intcrvlffwwr* that tbe r«tporM(«nt $«t««J bQf#4 
or prooccuplod during th« InttrvUM* Th« MfonpttoA b^ln^ 
m«da In uting thoto indlcatort U tHat, If iNi ratpondtnt 
chootot to t«rmln«t« tho lnt«rvlf<w, U rv/»t 4Mt«»«rln<] 1K0 
quottloot atkod, or It looking at hl$ Match, atklng th« nufub^r 
of qiMStiont loft, otc. It It b«cou«« h« or iK« f4»ttlt 
burdontd by tho tituatlon. 
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• Softer behavioral indicators, Including the stated unwillingness 
of the respondent to continue the interview for an additional 

15 or 30 minutes given a hypothetical opportunity to do so, or 
unwillingness to be rei ntervi ewed at a later date. 

• Attltudinal indicators measured through the reaction form. 
These include statements that the inter.iew was too long, 
uninteresting, unimportant, not time well spent, etc. Again, 
the assumption being made is that if the respondent makes 
negative statements of this type the treatment interview was 
to some extent burdensome, i.e., provided few rewards. 

In this section, each of the burden indicators is examined to 
determine if there are relationships between perceived burden and the 
length of the interview, the erfort required, or the overall treatment, 
involving the four combinations of length and effort. 

An overview of reactions to the Interview is presented In Table 9. 
In general, reactions were overwhelmingly positive. Only two of the 500 
respondents who had agreed to be interviewed broke off the interview 
prior to completion. (Both of these were in the long recall group.) 
For those persons completing the interview, the average item refusal rate 
was less than one percent, and the average item nonresponse rate (counting 
both refusals and "don't know" responses) was less than three percent.^ ^ 
Relatively few respondents (9%) were reported by interviewers as pre- 
occupied with the length of the interview. Large majorities felt that 
the interview was at least iomewhat interesting (87%), and Important (88%) , 
and that their time and effort were at least somewhat well spent (90%); 
80 percent said that they would be willing to be reintervlewed next year. 



Interviewers were asked to distinguish between cases where the 
respondent refused to answer a question ("refusals") and cases where 
the respondent did not have the information requested ("don't knows.") 
In many cases, the distinction was undoubtedly very difficult to make. 
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TABLE 9 

OVERALL REACTIONS TO THE INTERVIEW 



Behavioral Indicators 

Number of breakoffs • ' . Z 

Average Item refusal rate • ' , ^'^^^ 

Average Item non-response rate (refusals and "don't knows")* ' ^^7% 

Percent reported by Interviewers as preoccupied with the . • 

length of the fntervlev* • ' 313^ 

Percent willing to be relntervlcwed one year from now to f^"^ . • 
out If housing conditions had changed « . • ' 

Percent who would have been willing to continue with the In^*" . . 
view for at least another 15 minutes • ' ^>5^ 



Attltudlnal Indicators 

Percent feeling that the Interview was: 

Very or somewhat Interesting • ' , ^^51^ 

Very or somewhat important • ' 

Percent finding questions easy or very easy to answer. . . • ' ^S^i^ 

Percent feeling that time and effort put Into answering the . • 
questions was very well or somewhat well spent 

Percent feeling that the length of tne Interview was about . • . 
right • • 



42 



30. 



Finally, the respondents tended to rate the "nuisance" or "burden" of 
participating In this survey as being considerably less than that for the 
performance of other common tasks, such as filling out Income tax forms, 
balancing a checkbook, responding to political opinion polls, or getting 
a car Inspected (see Table 10). 

Because of this favorable reaction, we are left, for many Indica- 
tors, with the task of examining responses from a rather small minority 
of respondents to determine If length or effort had any bearing on 
their negative behavior or attitudes toward the interview. 

Behavioral Indicators are reported in Tables 11 and 12 and 
attltudlnal indicators in Tables I3 and 14. (Detailed responses 
to questions from which these tables are taken are shown In Appen- 
dix B.) There are statistically significant associations between many 
of these measures and the length of the Interview, Specifically: 

• Fewer long interview respondents would have been willing to 
continue with the Interview for an additional 15 or 30 minutes 
given the hypothetical chance to do so (39 vs. 75 percent); 
and more declined to be reinterviewed next year (27 vs 

13 percent) (Ta^le 12 )^ . _ 

• Long interview respondents were more frequently described by 
interviewers as "preoccupied with the length of the interview" 
(I'* vs. 5 percent for the short interview group). (Table 12.) 
Fourteen percent of the long Interview group vs. only five percent 
of the others said that "the time and effort put into answering 
the questions was not well spent." (Table ^3- ) 

• Nearly one-half of the long interview respondents vs. 13 percent 
of the others said the interview was "too long." Over one-half 
recodimended the use of shorter questionnaires as a way of 
improving surveys. (However, one-third of the short inter- 
view group also made this recommendation.) (Table 13.) 




TABLE 10 



HOW RESPONDENTS RATED THE "NUISANCE VALUE" OF THIS SURVEY 
IN COMPARISON TO OTHER COMMON TASKS . 



Question. From t n» to time we are all called upon to do various things which we may not particularly enjoy In fact 
some of these may be a downright "nuisance." We would like to know how much taking part In this survey bothered' 
you as compared to doing other common tasks, (FOR EACH TASK PUT DOWN THE NUMBER ON THE SCALE-l THROUGH 
lO-WHICH BEST DESCRIBES HOW MUCH IHE TASK BOTHERS YOU.) 



Answering the Interviewer's 
questions during this -iirvey. , , 

Filling out Income tax forms. . . , 

Balancing checkbook against bank 
statement 

Answering a public opinion survey 
about which political candidate 
you like better 

Going to the polls to vote on 
election day. 

Getting your car Inspected by the 
state , , ^ 



Doesn't 

Bother Me | — | — |- 
atAll 1 2 3 



Mean Rating 




5 6 7 8 9 10 



Bothers 
H Me a Lot 



Standard 
Deviation 



2.3 
3.5 

3.1 



3.2 



2.6 



3.4 



'Based on responses from 267-280 participants or %U of those completing the reaction form. 
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TABLE 1 1 



AVERAGE ITEH REFUSAL AND ITEH NON-RESPONSE RATES TO TREATMENT INTERVIEW 
BY INTERVIEW LENGTH, EFFORT, AND TREATMENT 





Niiinber of 
Respondents 
Contpteting 
Tredtment 
Interview 




Item Re 


fusal Rate' 


Item Non-Response Rate 


Hem 


Stdndard 
Deviation 


Tor F 
Vilufl 


2*Talleit 
Probability 


Hean 


Standard 
Deviation 


Tor F 
Value 


2-Talled 
Probability 



length 
Short • • I « 4 t 4 I « 
long 

Effort 

Recall 

Retrieval 



250 



.67 



3.II 



Treatment 

Short Recoil 

Long Recall 

Short Retrieval , . . , 
Long Retrieval 

Ovrall Results 



248 


.3* 




3I18 


M 


2.63 


150 


.55 


l.fi? 


175 


.69 


3.48 


173 


.28 


1.27 


75 


.63 


2.04 


75 


M 


1.70 



1.54 



.124 



.33 



.43^ 



.74 



.43 



.51 



2.42 



2.70 
3.04 



2.89 
2,82 



2.84 
2.94 
2.39 
3.25 

2.87 



4.54 
3.29 

4.16 
3.48 



5.01 
3.09 
3.16 
3.73 

3.97 



.94 



.20 



.630 



'See footnote p. 24 for definition of "Item refuial" and "Item non-response." 



.350 



.845 



.598 



exact 



TAtLE 12 



. «5WIID£KT IW¥IO» OURINC INTEWIEW AND UILLINGNESS TO PAHTICIPATE IN tOHCffl OR mil INtJUVIEVS, 
tr IKTEMIEV lENGTH, EFFORT, AND mm (In Pirctntign)' 





Unjth 


Effort 

i 




Trutinerit 






Ifldlcitor 


















TOWL . 


Short 






lifrlivil 

J 


1 jnMi t 


lOfl} 


Short 






lUull 


Xicill. 


Ritrlivil 


KltrliVil 

utriiv.li 


(n) 1 






















Did tin nipofldiAt iNi prioceuplid with thi lingth 




















or thi lAtirvm^thit l|| did tni riipomnt knp 




















looking It 1 Mtch» iiklnj Hm itfty qmitlont Mri 




















)«ft|ttef 




















Ytt 


s 




'10 


8 


0 




k 


12 


(«) 9 


iPtill Pll-I III 14 




86 




91 


ol 


86 


96 


fill 
op 


ILLt\ BI 


Slgnlflcinci 


P^.OI 






P<i.05 
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11 


12 


9 


It 


12 


? 


12 


( 29) 10 


1 lOttio vM DMn wiini)| to continm with thi 
























27 


1*5 


50 


oS 


22 


67 


32 


(132} 47 


1 would hivi prifirrid thi Intirvliw to bi 




















IS ilnutH ihortir 


25 


«ij 


J* 


33 


2I| 




26 


J9 


(94) 34 


1 wouii Mvi pnrirna Xm intirviiw to bi 




















}Oilwtii ihoftir* 


b 


IB 


9 


8 


b 


19 


b 


17 


(25) 9 


SIgntflcinci 






n.i ' 













Ututd you bt Nlllinf to bi InttrvlMid i yur froi 
ROM 10 thit M could find cut ntnthir your bouiing 
eondlttoni hid chinjidT 

^tti 1 1 1 1 1 1 1 1 t 1 1 1 1 1 1 ( 1 I 

^ > > • • • • I I 

Slgnlfleinci 

Nuibir AftMrlof lUtpondMt (ktntloni 

Nllllot but 



87 73 BO SO 86 
13 27 20 20 14 



74 
26 



p/.0i 



n.l 



P^.05 



71 (224) 80 
29 ( 56) 20 



I4i-I44 136.139 139 141 
54 Ml J 7 



70-72 67*69 71-72 69-70 280 
3-5 4*6 2*3 4.5 16 



Srenti on thli wd on lubuquwi tiblii uy wt «|ul 100 bociuii of rovndlni, 
nipooM did Nt ippiir on ihort IntirviM, 



TABLE I) 



REACTIONS TO SELECTED ATTITUDINAL QUESTIONS CONCERNING THE LENGTH OF THE INTERVIEW, BV LENGTH, EFFORT, AND TREATHENT 

(In P«rc<ntages) 



Qwstlon 


Length 


Effort ! 

1 


Treatment || 

1 TOTAL 


Short 


Loflg 


Recall 


Rttrlevtl 1 

'l 


Short 
Recall 


Long 
Recall 


Short 
Retrieval 


Long 11 
Retrieval! (N) 



How do you feel about the length of the Interview which 
you Just completed? (CIRCLE ONE NUMBER ONLY,) 

Too short ; , , , 1 I 1 

About right 86 52 69 

Too long , I3 h] 31 

Significance p < ,0001 

Ve have had a number of suggestions about ways In which our 
surveys could be Improved, How do you feel about each of these: 

Use shorter questionnaires; 

Would be an Improvement 3it 57 

Would not be an Improvement 66 h] 

Significance p<.'00r 



71 
29 



n,s 



0 0 

85 

51 15 
p < ,0001 



55 



if6 
51* 



33 
67 



57 



35 
65 



n.s 



P<.0I 



Overall, do you feel that the time and effort you 
put Into answering the questions '(as: 



I ( 2) 
56 (200) 7 
(85) 3 



57 



Very well spent 


33 


28 


32 


28 


37 


27 


28 


28 


(86) 3- 


Somewhat wel 1 spent. » . » . » > » > • > 


62 


58 


59 


62 


59 


59 


66 


58 


(172) fr 


Hot very well spent 


5 


li* 


9 


10 


l| 


lit 


6 


\k 


(27) 1- 


Significance 


.05 










n.s- 


























Number Responding 




I3I1.IM 


133-lV* 


IJ6.143 


66.7'! 


67-70 


69-72 


67*71 


269-287 


Hissing Cases 




6-13 


J».15 


5-12 


1-9 


3-6 


2-5 


3-7 


9-27 
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However, the length of the Interview was not related to el ther the 
I tern refusal or Item nonresponse rate. Nor was Interview length related 
to attltudlnal measures which did not ask specifically about the notion 
of length. For example, contrary to our expectations based on the 
theory of respondent burden presented earlier In this report, increasing 
the length of the interview did not seem to enhance the Importance of 
the study. In fact, slightly more of the long vs. short Interview 
respondents (15 vs. 10 percent) said that the survey was "not important," 
and the percentage saying that the survey was "very Important" was higher 
for the short than the long group (60 vs. ^0 percent). (These differences 
are not statistically significant, however.) Similarly, there were no 
significant differences between the long and short Interview groups In 
feelings about the interest level or difficulty of the Interview (see 
Table \k) . 

It bears repeating that for those behavioral and attltudlnal 
indicators where we did find differences based on length, the negative 
reactions reported here are based on a minority of respondents. For 
example, using the same data, we could also report that almost three- 
quarters of the long Interview group _is, wl I II ng to be rein tervlewcd 
next year, that over half felt that the interview length was "about 
right," and that about 85 percent felt that their time was at least some- 
what well spent. What Is Important Is that such favorable reactions 
were generally experienced by even more respondents In the short 
interview group. 




TABU 11, 

PEWOIT OF KJPONDENTS mim NEGATIVE »£*CTIONS TO THE ItfTEREST tEVEL, IMPORTANCE, ANO OIFFICULTY 
OF THE INTERVIEW, if EFFORT. AND TREATHENT 



Negative Attitude 



ftrill, Interview MS very Intereiting" or 
wtitell Iflteresting" 

Slgnlflunce' 

irvey m '^ot Importint" 

SIgnlfleince 

I the whole, enswering th« quejtlonj wii "herd" or 
•ry hird 'eiii«4f(,iit^i»iiv««*if 

significance 



Number Responding 
Hissing Cases 




13 '3 
n.s 



14 13 
n.s 



17 16 10 (}8) 1} 
n.s 



10 IS 


111 10 


10 


20 


10 


n (36) 12 




n.s 






n.s 




It 6 


$ 6 


k 


( 


k 


? (1?) 5 


n.J 


n.s 






ft.S 





I 



145.II17 I'tl-lifj |i,5.|46 ]kUU Ik 7I.;2 71.7J 70.;i 286-290 
2.'* ''•6 2.3 ^1 I 1*2 1-3 3-'* 6.10 



•significance based on chUsquere test on collapsed variables, not very/not at all Interesting vs. very/swiewhjt interesting. 
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In examining these tables. It Is also noteworthy that the effort 
variable (I.e., the recall vs. retrieval treatment) Is not associated wl th 
any of the Indicators of respondent burden as defined and measured In this 
experiment. That Is, there are no significant differences between the 
recall and retrieval groups In terms of overall item refusal or non- 
response, reported preoccupation with the length of the interview, 
willingness to continue the Interview or to be rel ntervlewed next 
year, or In general attltudlnal Indicators, This finding Is true 
despite the fact that the percent of applicable Items for which records 
were actually checked Is significantly greater (p.^^.OOl) for the 
retrieval than for the recall group (39 vs , 21 percent as shown in 
Table 15). 

Using tests of statistical significance as a criterion, this 
same finding emerges when effort Is examined as a behavioral, rather than 
as a treatment variable, that Is, when respondents are grouped by the 
percentage of times they actually checked their records for the answers 

^.toJBXPcnicirturfiL.ltems^^ -(See Table- 16) In. other words, while in both 

the recall and retrieval groups, a larger proportion of people who never 
referred to their records expressed negative attitudes towards the survey 
than did the record-checkers, these differences generally are not statis- 
tically significant. However, the tests of significance are based on 
very smoll N's; given the pattern of distributions In the table, it seems 
reasonable to hypothesize that failure to check records may in Itself be 
another manifestation of respondent burden. I.e., of negative feelings 
towards the Interview situation. Therefore, there may also be some relation- 
ship between respondent burden and data quail ty.^^ 

^^Thls thought will be explored further In a separate 8SSR paper 
which Is also based on the data produced by this study. 

50 



TABLE 15 



PERCENTAGE OF APPLICABLE ITEHS FOR WHICH RECORDS WERE CHECKED, 
BY LENGTH, EFFORT, AND TREATHENT 



Hean Percentage 



Number of Persws ^ "r uT c. . . r r ,r„. 

ConmlflUnn fh* Applicable Us. Standard T or F 2-TaIled 

Were Checked 



Length 

Short (250) 26.06 33.01 

Long (2't8) 27.20 3't.OO 

Effort 

Recall (3li8) 21.21 29.62 

Retrieval (I50) 39.21 38.3O 

Treatment 



Overall Results M) 26.63 33.^7 



.38 .1^ 



5.13 .001 



Short recall (I75) 2I.98 29.90 

Long recall ... . (173) 20.it3 29.39 

Short retrieval . . ( 75) 35.60 37.83 

Long retrieval. , , (75) l»2.82 38.68 



•since the variances among treatment groups are not homogeneous, use of the F statistic Is not strictly 
appropriate. Therefore, the exact significance level is not known. 

o 
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TOTAL 
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12 


1 


6 


(33) to 


1) 


9 


2 


(II). 7 


ttMltl'ngtobirilntirvtMd nwt yur 


2] 


16 


II 
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29 


16 


14 


(28) 20 
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9 


20 


(20) \k 


20* 


3* 


1* 

1 




F^lt iniMrln; qmitloni mi 'Itird" or *'viry bird*', 


k 


i> 


7 


(7) 5 


k 


9 


5 


IB) ( 


Wt MrviyMi unlntiniting 


17 


6 


1) 


(19) 13 


17 


21 


5 


(18) 1) 


flit tim ind iffort Mri not viry wll ipwt . . . 


10 


J 




l'3) 9 


16 


9 


5 


(14) 10 


Flit IntirvlM Ml "too long" , 


J2 


35 


17 


m 30 


34 


26 


25 


(41) 29 


Would hivi prifirrid Intirvlw to bi 15-30 itnutii 
ihortir ••».»,,,,,,,,,,,,,,,, 




1)6 


je 


(S9) ^) 


46 


41 


37 


(58) 41 


Mcoimndid usi of ihorttr quitttonnilri 




5) 


3! 


m 45 


S3 


52 


36 


(62) 46 



*Pit.05 



52 



Finally, no Interaction effects between length and effort and 
the various burden Indicators are apparent. While significant dif- 
ferences among the four treatment groups do appear for some indicators 
(e.g., preoccupation with the length of the Interview, willingness 
to be relnterviewed, and feelings about the length of the interview), 
visual Inspection of the tables reveals that these differences again 
reduce to differences between groups based on the length variable. 
In fact, when three-way tables were generated with length held constant 
(so that, for example, the short recall group Is compared only to Ihe 
short retrieval gioup and the long groups are compared only with each 
other), no significant differences in Indicators remained. 

As a check on the consistency of these findings, the overall 

burden or nuisance rating of the survey may be used. The average 

rating given by respondents In the various groups 1$ reported In Table 17. 

t 

No significant dMterences based on any of the variables manipulated in 
this experiment are evident. 

Upon reflection, this finding is consistent with those presented 
earlier; it appears that the behavioral Indicators as opposed to some of 
the attitudinal indicators or.d the nuisance scale are tapping into dif- 
ferent aspects of respondents' reactions or feelings toward the interview 
situation. This finding Implies that the phenomenon of "respondent 
burden" is multi-faceted and multi-dimensional. Specifically, when 
asked about length, respondents will say that a questionnaire is too 
long or that In general shorter questionnaires would be preferable. 
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In the course of a long Interview, a few respondents w? ? 1 show outward 
signs of their concern with time (check their watch > appear Impatient 
etc.). Yet these foellngs about the length of the Interview do not 
necessarily mean that the respondent resents the time spent» or feels 
unduly burdened by It, since on the nuisance scale, where respondents 
compared the Interview with other on*?rous tasks, long and short groups 
did not differ. Under the circumstances with attltudlnal Items yielding 
ambiguous data. It would appear that the most satisfactory overall 
Indicator of respondent burden Is stated willingness to be re-lntervlewed. 
This question yielded a more clear-cut division between the long and 
short groups, suggesting that length was Indeed equated with burden- 
someness by a minority of respondents. 

Validity of the Study Findings 

We have shown that there Is a relationship between interview 

length and several behavioral and attltudlnal indicators of respondent 

burden. This section examines the validity of that major study finding. 

Two of the validity Issues raised earlier are considered; 

• I nternal Val idi ty : the Issue here is to determine if the 
association between Interview length and respondent burden 
represents a causal relationship. 

e External Valldi ty : this issue concerns the stability of the 
findings, i.e., the extent to which they appear to be stronger 
for specific subgroups of respondents vs. the extent to which 
they can be generalized across all subgroups. 

Interview Length and Respondent Burden ; 
The Problem of Causal Attrltmtinn 

The association between interview length and respondent burden 

means that, for this group of respondents, it is possible to predict one 
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var^*'*^*' ^''om knowIe«*ge of the other. That Is, If we know the Interview 
Iari9'^ 9''0Up to which a respondent was assigned, wa can predict his or 
har ^'MMngnass to be re Interviewed, his or her attitudes toward the 
lanS'^ the Interview, etc. more accurately than If Information about 
Iori9'^ ^^^^ not available, However, prediction and causation are not 
syrjonymou*. Rather, Interview length and respondent burden may vary 
to^^'^er by virtue of their link with a third variable, e.g., "prior 
att^'^de* towards surveys. "'3 To explore this possibility. It Is lmport*int 
to deterfli'ne If the short and long Interview groups differ In terms of 
oth*'' Important variables which may provide an alternative explanation 
for obsgpyed relationships. • 

Differences between the groups for three categories of variables 
War** Examined; detf^Sraph^c variables; experience with and attitudes 
toW*'"^s surveys In general; and characteristics of this particular Inter- 
view experience. The relevant data are presented In Tables 18-20. 

^0 significant differences between the groups for any one of these 
Var^^^Ies Ware found. Therefore, the differences In perceived respondent 
bur^®*^ between the groups can not be "explained away** by other differences 
\^\ch mig^t have existed before the "treatment Interview" was applied. 
Thi/5» the likelihood of a causal relationship between Interview length 
and various aspects of respondent burden Is greatly strengthened. 

^^It should be pointed out, however hat these attitudes were 
n^e^s^^ed after the Interview and might therefore be "contaminated" by 
the "^st recent lntervif»^" experience. 



TABLE 18 

DIFFERENCES BETWEEN THE SHORT AND LONG INTERVIEW GROUPS: DEMOGRAPHIC CHARACTERISTICS 
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DIFrERENCES BEIVEEN SHORT AND LONG INTERVIEW GROUPS: PAST EXPERIENCE 
WITH AND AHITUOES TOWARDS SURVEYS IN GENERAL 
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TABLE 20 

DIFFERENCES BEMEN THE SHORT AND LONG INTERVIEW GROUPS: CHARACTERI STI CS 

OF THE INTERVIEW SITUATION 



Time Interview was Done 
DsytlniBt f » » » I • I f • ■ I ■ I ■ ( 



Short 



(N) 
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( 60) 2k 



Long 



(N) % 



(175) 71 
(70) 29 



Total 
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Stabllltv of the Study Findings : 
ExtTn«I V«lldltv Issua« 

To examine the stability of the study findings, the association 

between Interview length and various Indicators of respondent burden 

was analyzed for specific subgroups of respondents. Three Indicators 

were used: 

1. Unwillingness to be relntervlewed next year; 

2. Unwillingness to continue the Interview for an additional 
15-30 minutes given the hypothetical opportunity to do so; and 

3. Recommending the use of shorter questionnaires as a way 
of Improving surveys, 

The first Indicator was chosen under the assumption that unwillingness 
to be relntervlewed Is the ultimate response to the feeling that the Inter- 
view was an unpleasant, burdensome experience. The remaining Indicators, 
while not representing as strong a rejection of the Interview situation, 
were chosen because of the relatively large number of respondents expressing 
these reactions. 

In conducting the analysis, the strength of the association between 

111 

Interview length and the /arlous Indicators was measured using gamma. 
The strategy used was to compare the gammas for subgroup-i with the 
original gamma obtained for these same respondents without consideration 

^'^Gamma— which can range between -1.00 and -f-I.OO— Is based on 
the extent to which an Individual's value on one variable can be 
predicted based on his/her value on another variable. For example, by 
knowing that a respondent was assigned to the long Interview group, 
to what extent can we accurately predict his/her willingness to be 
relntervlewedt A gamma of, say, -K.yif means that we would do 7^% better 
than chance If we always predict that a long Interview respondent 
Is unwilling to be relntervlewed. 
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of their subgroup char«cteristlc. Large differences between the subgroup 
garmia and the original statistic would suggest thi^t the association 
between length and respondent burden Is stronger for one subgroup as 
opposed to others, Small differences, or no differences, on the other 
hand, would suggest that the main relationship holds regardless of sub- 
group . 

The analysis for demographic qroups Is presented In Table 21. 
The Information Indicates that: 

• For all subcategories, the percentage of ''burdened" Individuals 
Is higher for the long than for the short Interview. In most 
cases, the differences between the length groups are still 
statistically significant, based on Chi Square tests. 

• However, the relationship between length and unwillingness 
to be reintervlewed appears to be much stronger for certain 
subgroups as opposed to others, specifically for men, for 
employed persons, and for those with at least a high school 
diploma. (The differences between subgroups are not as 
pronounced for the other Indicators.) 

As might be expected, these demographic variables--! .e. , sex, 
education, and emp loymen t--are also associated. For example, a smaller 
proportion of males than females are "not employed" (21 vs. 51 percent), 
and have household Incomes of less than $15,000 (28 vs. 39 percent). 
Similarly, age is associated with occupation. Income, and education, 
with persons kO or older falling disproportionately Into the not-employed, 
lower inconie, and lower education categories. 

Since these variables are all associated, the effects of one may 
be confounded with the effects of the others. It Is therefore of some 
Interest to split the demographic subgroups into finer categories. In 
Table 22 the relationship between interview length and unwillingness 
to be reintervlewed Is shown for various subgroups of males and fema!es. 
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UNWILLINGNESS TO BE REINTERVI EWED BY INTERVIEW LENGTH, 
FOR DEMOGRAPHIC SUBGROUPS 
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•Note small "n's." 
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For tmt cattgorUt, th« rtUtlonthlp b«tw««n Ungth and burdtn r«malnt 
• troogtr for mn than for woman. (In fact, for woman undar «*0 tha 
ralatlonahip It ravartad, with mora parsons In tha long Intarvlaw 
group than In tha short group willing to ba ralntarvlawad. 
This diffaranca Is not statistically significant howavar.) This pra* 
llmlnary avidanca Indlcatas that tha sax differencas shown In tha aarllar 
tabia can probably bo genarallzad across many categorlas of man and woman. 
Similar tables might ba usad to detarmlna the "general Izabi 1 1 ty" of the 
survey findings for various age, Income, occupational, etc. categories^ 

Tha analysis for attltudlnal subgroups Is presented In Table 23> 
Tha table clearly shows that Interview length has a much weaker affect 
upon respondent burden for those persons favorably predisposed toward 
surveys. Among people who agree that answering surveys Is beneficial, 
tha percent refusing to be relntervlewed Is virtually Identical for 
the short and long Interview groups (8 and 10 percent respectively). 

For those who disagree, the spread between the long and short 
groups Is much greater, with 19 percent In the short group unwilling to 
be relntervlewed vs. M» percent In the long group. A simitar pattern 
is found for the other Indicators, with, again, the differences in 
respondent burden between length groups nore exaggerated for those 
persons with negative attitudes. 
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This finding It In lint with th« data from tha NORC study of 
farmart) rafarancad aarllar, In which NORC rataarchart concludad that 
tha ratpondant*t vlawt of tha quality and utafulnatt of turvayt ara 
a battar pradlctor of ratpondant burdan than ara althar Intarvlaw langth 
or numbar of Intarvlawt. And, In fact, In tha currant turvay, no ona 
In althar tha long or short groups who itronglv agraad with tha Idaa 
that survays ara ban«flcial (n«22) was unwilling to be ral ntarvlewad. 



No attempt was made In this study to validate the accuracy of 
tha Information given during the treatment interview. (For example, we 
did not verify amounts given for utility bills by checking with utility 
companies.) However, two rough proxy measures of data quality are 
presented here. 

The most direct measure comes from a reaction form Item In which 
respondents were asked their opinion of the accuracy of their responses 
to questions concerning utility bills and household expenses. (These 
were generally the Items used for the recall and retrieval treatments.) 
As reported In Table 99 percent of the people answ^rlnq this Item 
felt that their responses were "very" or "fairly" acct'^* with two-thirds 
of them choosing the first category. Only two responderiis In all cha'* 
racterlzed their responses as "Inaccurate." (We have no way of knowing, 
of course, whether this consensus means that the responses were Indeed 
accurate, or If It Implies that ttie respondents* standards for accuracy 
are low.) 
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•nd of rttrUval (72%) than rtc^tl (6lX) rttpondimu cMrtciffUtd 
thoir rotponioi oi *Wtry «ccwr«(«/» TN»«« diffor«nc«l b«ti4»rfi Untjlh 
groupi ond botMion offort 9rowp« «r« oot '^utttttcAt ly tk9(iHU«n(, 
hOMtvtr, although, for tht tffort v«rUblt, lh«y «rt In tht tA^tctf^ 
dlr«cllon, furth«imor«« lh« r«Utfv«l (rtitMini QfOiio «Uo f«<^«^ t»«U«r 
than tht rtcaM trtatmtnt group «tt«ng p«opt« f»vor«t»tv prtdUp^ttd XOm^ffH 
•urviyft (i,t,» among tho«« agrtaing th«t %yrvey% ara '^bana^UUt**)* 
Sav«ntyntna p«rctnt of thota IndlviduaU ailifd to chack thtir racordt 
fait that thair r«iponft«f "v«ry accurata'\ ai oppo%ad to 62 parcant 
atli«d to r«ly on mamory alona, a dlffaranca ^tgnlfUant at th« .0$ laval, 
(Saa Tabla2S. ) 

A fttcond m^tuf which m«y tm usad to aitaftt data quality It 
Uam nonraspwifta. By uftlng thli crltarlon» -v* af« •Aamtning a lUghtly 
dlffaranca aspact of data quality. I, a., tho co<nplatan« . of th« data 
set. It It, of cour»a« clear t^>at data may ba co(*iplata. and thut In 
ona tanfa quaMtatlvaly "hlgh^*, whMa ttlH baing Inucurata. and thus 
In anothar »an»e quaMtatlvaly "low." 

Tha criterion of compUtana** is usad In Tabia 26, i^hlch aj<a«lnas 
th« effact of th« racal l/ratr (aval treatment upon Item nonrasponsa. The 
table thows the percent of persons responding with "doo^t know" or 
refusing to respond at all for the recall/retrieval enpendlture Items. 
(Appandix C shows tha percent of respondents who actually checked their 
record* for each of these Items.) In general, the "effort" verlable 
does not ^flom to affect Item nonresponse; the percents of ••don't ki>ow*s" 
and refusals are similar for both the recall and retrieval groups and 
for tho four treatn«nts, Involving the various combinations of effort 
end Interview length. R C 
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TABLE 25 

PERCEIVED ACCURACY OF RESPONSE AMONG PERSONS WHO AGREE 
THAT "ANSWERING SUWEYS IS OF DIRECT BENEFIT/' 

BY rr .q)RT 

(In Pe^ce;^^-ages) 





Effort 


Total 




Reca 1 1 


Retrieval 


(N) % 




62 


79 


(106) 


70 


Fairly accurate or Inaccurate. , , . 


38 


21 


( '*5) 


30 


Significance 




P < .05 






Number Responding 


(76) 


(75) 


(151) 




Missing Cases 


( 2) 


( 1) 


( 3) 
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TABLE 26 

ITEH H(3^"^5PON5E (udoM'T KN0WS»» AND •'REFUSALS") TO EXPEMDITURE QUESTlONii BY EFFORT AND TREATMENT 



Ooi»'t know 
Rafusal. 

Premluw fti rjSS^rsJ.^ 
Don't ki>ow *'••'.. 
Refusal. 

don*t know 
Rafusal. 

Pfwiuw for j^gg^lolHTSnca 
Don't kt)^ 
Rafusa!. 

Watar Bill 

Don't know •.*••*<. 
Rafusal. 

on Bill 
Don't know 

Rafusal. . * • . . • . , 

Gas Bill 
Don't knoi' / 

RfffutSI. V " . # • . , 

Trash Bill 
Don't know 
Rafusal. 



Effort 


Treatment 




Rat.' leva 1 


Short 
Recall 


Long 
Recall 


Short 
Retrieval 


Long 
r.etr level 


(Ba5« 

N) 


X 


(Base 

N) 


(Base 

N) ^ 


(Base 

N) 




(Base 

N) * 


(Base <y 
N) ^ 


(107) 


1 
3 


i^'*) 0 
7 


( 51) 0 
(> 


(56) 


2 
2 


(21) 0 
10 


( 23) 0 
k 


( 39) 


8 
3 


( 15) 20 
0 


( 21) Jk 
5 


( 18) 


0 
0 


( 6) 17 
0 


( 9) 22 
0 




2 
7 


( 60) 2 
8 


(66) 3 
6 


( 65) 


2 
8 


( 31) 3 
6 


( 29) 0 

10 


(212) 


8 
2 


( 75) 13 
1 


(108) 0 
0 


(lOU) 


17 
5 


( 39) 0 
0 


( 36) 28 
3 


(118) 


8 
3 


( 52) k 
2 


•a 


(118) 


8 
3 


•a 


( 52) i» 
2 


(102) 


3 
k 


( ^) 3 
3 


(W) 7 
7 


(57) 


0 
2 


(21) 5 
0 


( 23) 0 

k 


(178) 


5 
2 


(66) 5 
3 


(87) 6 
1 


( 91) 


3 


( 30) 3 
3 


( 36) 6 
3 


(76) 


10 
5 


(28) 11 


(22) 


( 5^) 


13 
6 


( 6) 0 
0 


( 22) I'* 
5 
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TABLC 26--( .;oi<tlnu«d l 





Effort j 


Treatment 


QMstlon 


n«c«ll 


j Retrreval J 


Shqrt 
Recall 


Long 
Recall 


Short 
Retrieval 


Long 
Retrieval 




N) ^ 


! » 1 




(Base ^ 
N) * 


(Base „ 

N) 


(Base « 

N) ^ 



Car tnturancg Premium 

Ooo't •wow ^2i»3) 7 

RefuMi I 

Auto Reqiitratlon Faa 

Don *t know (2k3) 8 

Refusal g 

llectric Bill Ust Month 

l^^cw (319) 2 

Refusal 2 

glaetrle BlITr Month 2 

Don^j kno^ (3ig) 2 

Refusal 3 



Electr»e Blllt Month ^ 

Ooo't know 

Refusal 



Phone Bill: Uit Month 

Don't knowrf 

Refusal 



Phone Bill; Month 2 
Don't know .... 
Refusal 



(316) k 
3 



(332) 1 
2 



(33M 2 
2 



Phone Bill; >tenth } 

Don't know (333) 6 

Refusal 2 



( 9^*) 8 
2 



( 9**) 6 
0 



(139) 2 
2 



(137) I 
I 



(137) k 
I 



I 



(126) 6 
2 



(126) 6 
0 



(162) I 
2 



(162) 2 



(161) if 
3 



(160) 



(l'»2) 5 (162) 2 

I 2 



(1 15) 6 
I 



(115) 9 
0 



(157) 2 
2 



(157) 3 
2 



(157) if 
2 

(172) I 
2 



(172) 3 
2 



( 50) 6 
0 



( 70) I 
I 



( 70) I 
I 



( 70) k 
I 



(69) 3 
. I 



( 69) ^ 
I 



( 50) 6 {^) $ 

0 k 



(m 6 (161) 5 (172) 8 ( 68) 7 



{^) 7 
0 



(69) 3 
3 



( 67) 0 
2 



(67) 5 
I 



( 73) 0 
I 



( 73) 5 
I 



( 73) 10 
I 



'Question not asked In short Interview. 
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In Table 27i the completeness criterion Is used again, this 
time In e^camlnlng the effect of Interview length upon data quality. 
Table 27 focusses specifically on Ve long Interview group; It presents 
the pattern of nonresponse occuring during the Interview by showing 
the percent of "don't know' s" and refusals for the first and last set 
of I tens asked. 

The table indicates that Item nonresponse did not increase as 
the interviCKtf proceeded. In fact, the only items eliciting a nonresponse 
rate of at '.east five percent are those involving Income. For these 
items, nonresponse Is rel&t'vely high both at the beginning (Q. 7) and 
at the end of the Interview (Qs. 301, 302, and 30^). It appears, then, 
that the sensitivity of the question, rather than Its time placement 
In the Interview, was the key factor contributing to Item nonresponse. 

In summary, the information available from this study suggests 
few differences in data quality (accuracy or completeness) based solely 
on Interview length or effort. To reiterate, however, the measures 
used were poor proxies for Independent checks of quality, at least 
from the standpoint of data accuracy. 



As part of the follow-up questionnaire, respondents were asked 
to react to specific questions during the interview, by indicating if 
"most people" would find each item "too personal" or "hard" to answer. 
The items selected Included some of the Annual Housing Survey questions 
of parti cular* Interest to HUD, as well as those items which were varied 
as part of the recall/retrieval treatment. 



Reactions to Specific Questions 
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TABLE 27 

ITEH NON-RESPONSE AT VARIOUS POINTS IN THE LONG INTERVIEW 
(In Percent«9«fl) 





R«c«ll 


Retrieval 




OK 


Refusal (Base N) 1 


OK Refusal (Base N) 



Flnt 10 Oueittofis 

1. Household enumeretlon 0 

2. Date of birth/age of household 

members 0 I 

3. Race/ethnic descent - 1 

k. Highest grede of school completed. . 0 I 

5. Highest grade of school - Spouse , . I I 

6. Employment status - 0 

7. Income renge I 8 

8. Residence (city, stete) In 1970. . . I 0 

9. Residence In city or town 2 0 

10. In Armed Forces In 1970 - 0 

Lett 15 Questions** 

277. Price paid for gallon of gas. ... k 0 

278. Enough gas I 0 

280. Ves R. employed lest week - 0 

283. OHe-wey dtstence to work k 0 

264. Objections to commute 0 .0 

289* Principal transportation to work. . 0 0 

291. Why cer It used 0 0 

292. Does R. drive along 0 0 

295. Where bar Is parked 0 0 

296. Does employer provide parking .. . 0 0 

30le. Amount eerned by respondent In 

last 12 months I 8 

301b. Antount earned by 2nd H.H. member. . 0 17 

302. Amount earned from business/ 

partnership 0 7 

303* Wes money received from various 

sources 0 0 

30^*. Amount earned from Interest on 

sevlngs/bonds 19 12 

*DK not el lowed as a response option. 

'^Sklp questions with e small base N are not Included. 



(173) 
(173) 
(173) 
(112) 
73) 
073) 
(173) 
(173) 
(173) 

(115) 
(MM 
( 88) 
( 7^*) 
( ^2) 
( 7i») 
( 61) 
( 61) 
( 51) 
( W») 

( 72) 
( ^) 

( 73) 

( 7U) 

( '»3) 



I 
0 
0 
0 
0 

II 

0 
0 
0 



(75) 

(75) 
(75) 
(75) 
(50) 
(75) 
(75) 
(75) 
(75) 
(75) 



2 


0 


(Wf) 


2 


0 






0 


(33) 


0 


0 


(27) 


0 


0 


(16) 


0 


0 


(28) 


0 


0 


(22) 


0 


0 


(22) 


0 


0 


(18) 


0 


0 


(17) 


12 


23 


(26) 


11 


22 


(18) 


k 


19 


(26) 


0 


k 


(27) 


8 


25 


(12) 



73 



ERIC 
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Respondents' reactions, which are shown in Table 28, are consistent 
with those reported earlier in connection with item nonresponse. That 
Is, those items aslclng about income or e^cpendi tures were tagged as 
personal or difficult by a larger proportion of respondents than were 
other items on the list. For e;<ampie, the question concerning house- 
hold income was flagged as at least "somewhat too personal" by 70 percent 
of respondents and as at least "somewhat hard" to answer by US percent. 
The mortgagt. payment question was labelled as at least "somewhat too 
personal" by 58 percent of respondents and as at least **'somewhat hard" 
to answer by one-quarter of the group. One-half of the respondents 
stated that "most people" would find questions about welfare payments 
"too personal." Not surprisingly, questions about number of rooms 
elicited far less negative reaction. 

Table 29 shows the differences in reactions to income and expen- 
diture questions between the length and the effort groups and among the 
four trejtment groups. Significant differences were found for two itens: 
the income question (which, interestingly, was asked in the same 
way for al) groups), and the "mortgage payment" question. One-third of 
respondents In the long retrieval group found this latter item at least 
somewhat hard to answer. Under the given cell sizes, no other differences 
shown in the table are statistically significant. 
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TABLE 28 



PERCENT OF RESPONDENTS EXPRESSING NEGATIVE REACTIONS TO SPECIFIC ITEHS IN THE INTEflVIEV 



(luettlons ! Now, i 'd )lkt to get yott Ideas about som of the (ji'estlons yoti nay have been asked. 

For each of the questions below, please show whether you feel that most psople would find 
ths question much too persoial, somewhat too personal, or not too personal. 
(CIRCLE ONLY ONE NUHBER FOR EACH QUESTION.) 

X X X X 

Nw, please look at these same Items again. This tim, show whether you feel that 
irost people would find the question very hard, soiMwhat hard, or easy to answer. 
(CIRCLE ONLY ONE NUHBER FOR EACH WESTION.) 





Huch Too 
Personal 


Somewhat Too 
Personal 


Very Hard to 
Answer 


Somewhat Hard 
to Answer 




(N) % 


(N) % 


(N) I 


(N) % 




(67) 


2k 


(131) 




(29) 


10 


(108) 39 


Mortgage payment 


^♦0) 


18 


(92) 


1*0 


(17) 


8 


(36) 16 


Rent payment 


(2) 


5 


(8) 


19 


(I) 


2 


( h) 9 


Lajt utility bill 


(7) 


2 


m 


16 


(8) 


3 


(71) 26 


Number of bathrooms 


(6) 


2 


(13) 


5 


(2) 


1 


( 7) 2 


Number of bedrooms 


(5) 


2 


(I'f) 


5 


(2) 


1 


( 6) 2 


Presence of open cracks/holes In 
walls/cell Ing 


(7) 


2 


(38) 


14 


(5) 


2 


(37) 14 


Money received from welfare/public 
, assistance. . . 


(6^*) 


26 


(65) 


26 


(22) 


9 


(43) 18 



^Thls table Is based on responses from 245-283 individuals or 83-96% of the 296 people filling out the 
,^ reaction fora. 
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PHCEHT OP mmm mm twt w peopie'.' voiid find mm wmmn m 'vew haw 

OR "SOMWWT WW" TO ANJWH, BV '.ENOrH, l.'rDRT, AND TREATHEHT 





Uni 


]th 


Effort 


Treitment 




ItM 


















TOTAL 




Snort 


long 


Riull 


Retrlival 


Short 


Long 


Short 


Long 


(N) X 






RieiM 


Ricill 


Rttritvil 


Ritrtml 

1 


^t»l Houfehold IncoM* 






















6 


|1> 


6 


15 


4 


8 


8 


21 


(29) 10 




37 


l>l 




32 


48 


45 


27 


37 


(108) 39 




P<.05 


p <»0I 






p<.0l 


























Ham liAvJ 




10 


l» 


II 


l» 


It 


6 


17 


(17) 8 


jowwws naro • i , t » • » • i 


ii 


IS 


18 


ll» 


23 


13 


11 


17 


( 36) 16 


}tgniricincfl 


n.s 








p <.05 


























'^'T ^^^^ ' < • * 1 « « « » < < » « « 1 • 4 « 1 « 1 1 f 


0 


5 


k 


0 


0 


9 


0 


0 


( 1} 2 


SfliMwhit hflrd 


13 


5 


9 


9 


18 


0 


8 


10 


{ 9 


dijniriuncQ 


n.s 


n.s 






n.s 






U UtMitv Bill 






















1 


k 


2 


4 


2 


1 


1 


7 


( 8) 3 




23 


28 




27 


22 


26 


24 


30 


(71) 26 


Slant flcincfl 


n.i 








n.i 






ny RtceivM from Ve'fin" 






















7 


11 


7 


II 


6 


7 


8 


14 


f 22) Q 


oiKwhit hird 1 1 • i • 1 1 • « * •••lit* 


13 


22 


17 


•8 


13 


22 


13 


23 


(43) 18 


SlgnlfleanM 


n.i 


n.i 






n.i 






Number Rtipondlng 


123-139 


122-138 


122-137 


123-11(0 


62-69 


60-67 


61-71 


62-71 




NUsIng uses 


10-26 


9-25 


11-26 


8-25 


6-13 


6*13 


3-13 


3-12 





'These Itew were not varied for the recell, retrieval treatment. 

^Tcsti of jlgnlfleewe bojed on Ihl-Squere tijing three response options, I.e., "very hard," "sonicwhat hnrd," and "easy." 
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IV. IMPLICATIONS OF THE FINDINGS FROM f-HASE I 



Phase I of the Respondent Burden Study attempted to test some 
of the assumptions Inherent In Federal policies as well as those made 
by survey research professionals concerning the correlates of respondent 
burden. As reported In this document, the data available from the first 
phase of the study validate some of these assumptions In part, while 
leaving others open to serious question. We believe that these findings 
have a number of theoretical and practical Implications for researchers 
and survey sponsors: 

1. Before entrance to the household Is gained, tht; disclosed 
length of an Interview does not appear to affect refusal decisions. 
Moreover, refusers are much less likely than cooperative respondents to 
have been recent survey participants. As demonstrated by this and by 
other current research » burden concerns do not appear to be tUe primary 
reason for most refusals. 

2. However, based on our findings, the conventional wisdom about 
the burdensomeness of lengthy interviews Is partially bor'ne out with 
respect to those persons who have agreed to be Interv!ev/ed» at least for 
a "general Interest" survey which does not deal with riatters highly 
germane to the Interests of the respondent. (Th? burdensomeness levels 
for Interviews dealing with highly respcndent-pertlntnt Issues, for 
example, certain types of health Interviews, may be very different.) 




3. Although It would no doubt be appropriate to test other 
^'effort'' treatments, the findings suggest that effort as operational ized 
for this study (I.e., asking respondents to provide estimates vs. asking 
them to check records) may not affect perceived burden as postulated In 
the Bradburn model. 

k. Belief In the efficacy of surveys clearly emerged as an 
Important factor In feelings of burden, perhaps even overshadowing the actual 
length of the Interview. The findings suggest that It Is not a question 
so much of the Importance of the specific survey itself, as of a more general 
belief In the efficacy of surveys (or perhaps In the efficacy of Individuals 
to affect the actions of decision-makers) which Is operative. 

It follows, therefore, that to reduce self-perceived burden. It 
Is Important to convey to potential respondents the Importance and use- 
fulness of the survey method, and the likelihood that survey data will 
be used by survey sponsors. Our findings suggest the need not only for 
careful and convincing explanations to persons being contacted for surveys, 
but also for continuous attention to the reporting of surveys In the 
media and other "Image creating" and public relations mechanisms. They 
also suggest that the survey profession would be well-advised to emphasize 
the Importance and direct utility of Its work when contacting respondents, 
rather than putting the emphasis on minimizing burden or Inconvenience 
as they relate to questionnaire length. 

5. This study has focussed on sources of respondent burden and 
factors which may contribute or a 1 levia te • the degree of burdensomeness 
which respondents experience when participating In household surveys. 
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The relationship between perceived burden and the quality of the data 
obtained during the Interview T.s a complex and Important Issue, but one 
which this research has only addressed tangentlally. Our early findings 
suggest that Interview length Is not a major factor affecting quality, 
but» If this topic Is to be addressed fully, experimental research targetted 
specifically to this Issue Is required. 




APPENDIX A 
RESPONSES TO THE REFUSER FOLLOW-UP FORM 



• Ws're Tnterasted Tn finding out tha main reasons you didn't want 
to take part In this survey. Can you tell me why you didn't wish 



to participate? 

interview would take too much time, respondent 

w^s too busy (2*4) 21 

Couldn't do Interview (too old, sick, language 
barrier, death In family, other personal 

problems) (21) 18 

Didn't want to be bothered, didn't feel like 

It, not Interested (21) 18 

Didn't want privacy Invaded, didn't want to 

divulge Information (10) 9 

Time was Inconvenient (9) 8 

Didn't want to take part, participate In surveys. (9) 8 

Felt that surveys are disguised sales pitches . . (5) k 

Disapproved of Interviewer behavior (*♦) 3 

Sponsorship of survey (3) 3 

Nothing to say, couHn't answer (2) 2 

Didn't feel survey would be useful (1) 1 

Other reason, or reason not determined (10) 9 



Percents based on II5 refusers for whom some Initial ontact 
was made (I.e., phone numbers were found and someone answerer, tt*^ 
phone). Multiple responses were allowed. 
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Vt*d llktt to knOM about p«opte*s past experience with surveys. 
$f survey* ti^i do not mean Interviews with personnel officers, 
credit Invest 1 9a tors » social worlcers and the like,, or so-called 
'■polls** or *Vesearch** which are really sales pitches. Rather, 
ty survey* we mean research conducted to find out about how people 
•re 9ettln9 along, their homes, what they like or how they feel. 



Thinking about surveys in that way, have you been asked to take 

part In a survey during the past two years? (DON'T INCLUDE 

THIS SURVEY.) (^^ ^ 

YES (ASK Q. 3) (15) 20 

NO ^ (51) 69 

OOM*T KNOW \ (SKIP TO Q. 5) (8) 11 

Number Responding (7^) 100 

•MTssfng (33) 

TOTAL (107)* 

How long ago was that? (IF MORE lUM ONE SURVEY, DETERMINE HOST 

RECENT DATE.) (N) % 

0 TO LESS THAN SIX MONTHS ACQ (k) 2? 

SIX MONTHS TO LESS THAN ONE YEAR AGO (U) 27 

\ 

ONE TO TWO YEARS AGO (3) 20 

OCN*T KNOW (*♦) 27 

Number Responding (15) 100 

Missing (0) 

TOTAL (15) 



*As explained In the text, the N of 107 Is the number of refusers 
with whom contact was established and who spoke English. This N Is used In 
subsequent tables although only 59 persons went through the entire refuser 
Interview. 
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k. Old you take part In that survc/? 

(N) 



YES (11) 73 

NO (3) 20 

DON'T HEMCMBER (1) 7 

Number Responding (15) 100 

Hissing (0) 

TOTAL (15) 



5. t Kave som statements about surveys. As I read each one. 
please tell me If you strongly agree* agree* disagree* or 
strongly disagree with It. (REPEAT RESPONSE OPTIONS AS 
NECESSARY.) 



a. Answering sur'Oyfs is uf direct benefit to the 
people who answer: 

Strongly agree (1) 2 

Agree (25) 50 

Disagree (2-.] 

Strongly disagree (*') 



Number Responding (50) 100 

Missing (57) 

TOTAL (107) 
b. Too many surveys are being conducted these days: 

Strongly agree (18) 36 - 

Agree (21) ^2 

Disagree (11) 22 

Strongly disagree (0) 0 



Number Responding (50j 100 

Missing (57) 

TOTAL (107) 

S3 
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c« Taking part In surveys can give me a chance to talk 
about Interesting topics: 

JUL JL 

Strongly agree (0) 0 

Agree (22) ^5 

Disagree (26) 53 

Strongly disagree (0 2 

ber Responding (^9) 100 

Ml sing (58) 

TOTAL (107) 

d. By taking part In surveys, I can affect the 
government*^ decisions; 

Strongly agree (2) k 

Agree (20) ^#3 

Disagree (20) ^#3 

Strongly disagree {k) 3 

Number Responding (^6) 100 

Missing (61) 

TOTAL (107) 

e. Surveys ask questions that are too personal: 

Strongly agree (10) 21 

Agree (25) 52 

Disagree (13) 27 

Strongly disagree (0) 0 

Number Responding (^8) 100 

Missing (59) 

TOTAL (107) 

f. The most Important vay to Improve the quality of life 
In Ame^'ica !s oy taking surveys frequently: 

Strongly agree (0) 0 

Agree (16) 38 

Disagree (20} 48 

Strongly disagree (6) \k 

Number Responding (42) 100 

Missing (65) 

O TOTAL (107) 
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6. Now a quottlon about yourself. Are you currently working full-time, 
working part-tlmei a full-time student, a homemaker or what? 
(CIRCLE ONE RESPONSE ONLY. IF MULTIPLE RESPONSES, CIRCLE RESPONSE 



WITH LOWEST NUMBER.) 

JNL JL 

WORKING FULL-TIME (22) ^0 

WORKING PART-TIME (3) 5 

FULL-TIME STUDENT (1) 2 

LOOKING FOR WORK (0) 0 

HOMEMAKER (19) 3U 

UNABLE TO WORK (0) 0 

RETIRED (9) 16 

OTHER (SPECIFY): . (1) 2 

Number Responding (55) 100 

Missing (52) 

TOTAL (107) 

7. Now that we've had a chance to talk, would you be willing 
to have the Interviewer come back to your home to do the 
Interview? 

Yes (9) 15 

No (Mf) 7** 

Don't kn<.>w (6) 10 

Number Responding (59) 100 

Mfsslpn (U8) 

TOTAL (107) 
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APPENDIX B 



RESPONSES TO THE REACTION FCRM 
BY TREATMENT 



S<5 
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IW: 6-10 

Ur 



HU: 



REACTION FORM 

M art asktng you to fill out this form booiuse w« would like .o find out 
hOM you fael about survays In general and about this survey In particular. 
Most of the questions can be answered simply by circling or wrltlng.a 
number* If you have trouble with any of thi questions , please note this 
on the form, and try to answer as best you can. The Interviewer 1 3 not 
permitted to answer questions about this form. When you have finished, 
the Interviewer will return the form to the office In a sealed envelope. 
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You hivi juit Ukin pirt In a lurvay. Thi purpose of lurv^yi li to obtain Information about how people 
^ an gttiing along, their work, their homei; what they like, or how they feel. Thli li done by asking 
qMitloni of a small, but scientifically selected, group of people. 

Interviews with social workersi personnel officers, credit Investigators, etc, are not surveys, .lor are 
lo-called "polls" or "research," which are really sales pitches. 



t, Thinking about surveys In this way, had you ever taken part In a survey-elther by mall, over the 
telephone, or In person-before this Interview? 





Short 
Recall 

(N) % 


Long 
RecAl 1 

(rt % 


Short 
Retrieval 

(N) % 


Long 
Retrieval 

(N) % 


TOTAL 
(N) %^ 


Yef (ANSVEft Q. 2) 


m 71 


(50) 71 


m 68 


(50) 73 


(196) 71 


No (SKIP TO Q. 3) 


(20) 29 


(20) 29 


(22) 32 


(19) 27 


(81) 29 


Don't remember/know 


(3) 


(1) 


(1) 


(2) 


(7) 


No answer 


(3) 


(2) 




(3) 


(12) 


TOTAL (N) 


(75) 


(73) 


in 


m 


(296) 



°Percents may not always total to 100 because of rounding error. Similarly, percents may 
differ slightly from those In body of report also because of rounding error. 



2, Vh«n wii tti« lait time yew took part In a lurvay? (CIRCLE ONE NUHBER ONI.v.) 



Short 
Recall 

% 



long 
Rocall 
(N) % 



Short 
Retrieval 

(N) % 



Long 
Retrieval 

(M) % 



Over one iwnth, but less than 
six months ago 

Six months to less than 12 
"wnths ago 

A year ago o.' more 



Ho mm 



(11) 26 
(19) 



Don't remefnber/know (;) 



(0) 



(13) 28 
(16) 35 

(3) 
(I) 



(0) 



(2) 
(0) 



TOTAL 

(N) 



Within the past month (3) 7 (5) „ (5) ,2 (2) 1^ (,5) g 



(9) 21 (12) 26 (8) 19 (11: 23 (l»0) 22 



26 (13) 27 (i(8) 27 
(19) hk (22) k(> (76) kt 



(16) 
(I) 



Total 



(^^9) 



(50) 



('♦7) 



(50) 



(196) 



)♦ To what wlent do you iflrefl or dliagrea with each of U 'c! lowing stataments .ibout surveys 
In general? (CIRCLE ONE NUHBER FOR EACH STATEHEMT.) 



• 


Short 
Recall 


Long 
Recall 

(W I 


Short 
Retrieval 

(N) % 


Long 
Retrieval 

(N) 


rOTAl 
(N) X 


a« Answering surveys Is of direct 
benefit to the people ^hc 


















answer: 


















Strongly agree 


(5) 


7 


(7) 


10 


(7) 


II 


(3) 5 


(22) 8 


Agree «•••,,, i , 


(37) 


52 


(29) 


<)3 


(30) 


ii6 


(36) 56 


(132) Its 


Disagree 


(29) 


k\ 


(27) 




(25) 


38 


(23) 36 


(104) 39 


Strongly disagree 


(0) 


0 


(5) 


7 


(3) 




(2) 3 


(10) If 


Number responding 
Nissing 


(71) 




(68) 
(5) 




(65) 
(9) 




m 

(10) 


(268) 
(28) 


Total 


(75) 




(73) 




(7'i) 






(296) 


b. Too mi surveys are being 
conducted these days: 


















Strongly agree 




6 




6 


W 


6 


(M 6 


(16) 6 


Agree , $ i , » , , , t , , 


(28) 


39 


(18) 


28 


(18) 


28 


(15) 23 


(79) 30 


Disagree 


(36) 


51 


(37) 


58 


(38) 


59 


(38) 59 


57 


Strongly disagree 


(3) 


It 


(5) 


8 




6 


(7) 11 


(191 7 



Number responding (71) (C'l) (6I|) {^k) (263) 

Hlss'ng W (9) (10) (10) .^Mn)' 



ERIC 




Short 
R«trlov«l 



Long 
.^Jtrloval 
(N) % 



TOTAL 
(N) % 



c, Taking part In iurvayi can 
give m a chanca to talk 
flboiit Intarejting topics: 

Strongly agree 



o'^gi*" 

Strongly disagree 



(7) 10 
('♦0) 58 
(21) % 



W 6 

(3'*) 52 

(22) 3'* 

(S) 8 



(M 6 

C^O) 62 

(l3) 28 

(3) 5 



(8) 12 

(37) 57 

(16) 25 

W 6 



Number responding 
Hissing 



(69) 
(6) 



(65) 
(8) 



(65) 
(9) 



(65) 
(9) 



By taking part In surveys, 
I can affect the 
government's decisions: 

Strongly agree 

'^Sree 

''•"grw 

Strongly disagree 

Number responding 
Hissing 

Total 



(5) 


7 


(3) 


5 


('•2) 


53 


(33) 


52 


(17) 


23 


(18) 


28 


(8) 


1) 


(10) 


16 


(72) 




(64) 




(3) 




(9) 




(75) 




(73) 




91 



(6) 9 

(30 48 

(18) 28 

(10) 15 



(6) 9 

(311) 50 

(18) 26 

(10) 15 



m 

_(6) 



(23) 9 

(151) 57 

(77) 29 

03) 5 



(32) 




(20) 7 

(lltO) 52 

(71) 26 

(38) l>i 



(269) 

m 

(296) 



3 "(cowtlnuf d) 





Short 
Recall 

(W % 


long 
Recall 

(N) % 


Short 
Retrtflvnl 
(li) X 


Long 
Retrieval 

(N) % 


TOTAL 

(M) 


e« Survsyi itk quoi^'loni th«t 
aro too p«rion«l; 






















Strongly agree 


(M 


6 


(5) 


8 


(3) 


5 


(M 


6 


(16) 


6 


Agree • t • • • « • • • • • 


(18) 


26 


!I6> 


2ii 




W 


(16) 


21) 


(70) 


26 


OfMgrM. 


(hi) 


61 


(38) 


57 


(3B) 


58 




61 


(159) 


59 


Strongly disagree 




7 

1 


lo| 


11 

IZ 


{'♦) 


6 


(6) 


9 


(23) 


9 


Nuinber responding 
Hissing 


(69) 
(6) 




(«) 

(A 




(65) 




(67) 
17) 




(268) 
(28) 




Totil 


(75) 




(73) 




(7't) 




m 




(296) 




f. The nest Important way to 
Improve the quality of life 
In America Is by taking 
surveys frequently: 






















Strongly agree 


(5) 


1 


(M 


6 


(II) 


16 


(« 


f 




9 


Agree . , , , 


(37) 


52 


(29) 


^) 


(28) 


^\ 


(29) 




(123) 


^♦5 


Disagree 


(19) 


27 


(23) 




(23) 


33 


(23) 


36 


(88) 


32 


Strongly disagree 


(10) 


|1» 


(12) 


18 


(7) 


10 


(8) 


12 


(37) 




Number responding 
Hissing 


(71) 
W 




(68) 
(5) 




(69) 
(5) 




(W) 
(10) 




(272) 




Total 


(75) 




(73) 




(7't) 




(7M 




(296) 
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K Ovirill, hM Intiriitlfig wii \k Intirvliw you Juit ctwptited? 
(CIWUfflSNUHSEHONLY.) 





Short 

f^QCllI 

(N) X 


Long 
Rtcall 

(M) X 


Short 
litrltvil 

(K) X 


long 
Mtrlivnl 

(N) % 


TOTAl 
(») X 


Viry liitireitlmj 


(22) 30 


(25) 35 


(19) 27 


(17) 




(fill }Q 


Sofinwhat 'ntarMtlng 




'3'») W 


(M) 58 


W 


66 


(165) 5B 


Not viry lnt«r«itlng , 


(7) 10 


(B) n 


(10) ti» 


(6) 


9 


(31) 11 


Not at ad liUreiilng 


(1) 1 


(M 6 


(I) I 


(1) 


1 


(7) 2 


Nufuber rpi ponding 
Hlsi!n9 


(I) 


(71) 

(!) 


(71) 
(3) 


(70) 
(M 




(10) 


Total 


(75) 


(73) 


(7M 


m 




(296) 
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5, How do you f«l about th« Ifuporiiinc* of thli lurvey? 
(CIRCLE ONCNUHBER ONLVj 





(II) X 


lonii 
Rocoll 
(N) X 


jnori 

Ratrloval 

(N) X 


Long 
Kttrlivil 

(N) X 


roTU 

(N) X 


Not Important 


il) 10 


(|l») 


iO 


(7) 10 


(8) 11 


(36) 12 


Som«wh*t Important, , . , 


(53) 72 


m 


(8 


(t<6) 


(50) 70 


(197) 68 


Viry Inportint 




(3) 


13 


(19) 26 


(13) 18 


(55) 19 


Numbor res pond Int) 
Hl$llng 


m 

(1) 


(71) 
(2) 




(72) 
(2) 


(71) 
(3) 


(288) 
(8) 


Total 


(75) 


(73) 




(7'*) 


(7it) 


(296) 
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Nuffl6«r raspondlng 
Hilling 





jnon 


Olillkul It virynHJch 


(0) 0 


hi lit i • 

fliHkid Itiomwhit 


(0) 0 


Ntltfy/,IIkid It nor didlkid It. 


(6) 8 


Llkid It iflDiwhit 


(i;) jj 


Llk«d It virynHJch 


(51) 69 



(0) 0 

(0) 0 

(0 e 

(18) 25 

m 67 

(72) 



Short 
llitrltMl 

X 



(0) 0 

(0) 0 

(7) 10 

W 19 

(51) 71 



(72) 
(2) 



Lono 
« 

Ntrlivnl 

(N) t 


Torn 
i") » 


(1) 1 


(1) t 


(01 0 


(0) 0 


(5) ; 


(2<*) 8 


(IJ) 18 


(62) n 


(52) 7) 


(202) 70 


(711 
(3) 


(289) 
(7) 
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How do you fwl «b<»it lh« Unqth of ilm lnt«rvlw wMch ywi jiitt wUt^rf^ 

(cincu]2!!£NUHm omv.) 





Short 
(H) IS 


lonq 
(N) % 


Ihort 
Mtrt«v«l 
(N) X 


Ntfltva) 
(N| t 


TOTAL 
(N) 1 


Tco tHort 1 1 1 • 1 I 1 « 1 1 1 


(1) 1 


(0) C 


(0) 0 


10 » 


(}) 1 


About rlqht ,.«....... 




(3M 






|;oo) 70 


Too ion()i « * I « 1 • • • • I 1 


(8) II 




no 15 


(JO) 


m JO 


Nutnber riipondlfu) 


(?t.) 
(1) 


(;o| 

(3) 


m 

it) 


(?0 
()) 


(») 


TotrtI 


(?5) 


{;3) 


(?'♦) 


w 





Do 



8. Wfi had tliw to ask our most Important questions during this Interview, but It would have been useful 
for oi.r study to ask some additional questions. On the other hand, we could have left some out to 
trte Interview shorter. Please circle the number of the one answer below which comes closest 
to your feelings: ~" 



Short 
Recall 
% 



1 would have been willing to 
continue with the Interview for 
another 30 minutes. 

I woulo liave been willing to 
continue with the Interview 
for another 15 minutes 

I would have preferred the Inter- 
view to be I") minutes shorter 

I would have |.'^flferred the Inter- 
view to be 30 minutes shorter^ . 



Long 
Recall 
% 



Short 
Retrieval 

% 



Long 
Retrieval 

% 



TOTAL 



(8) n (8) 12 (5) 7 (8) 12 (29) 10 



(^7) 65 (15) 22 67 (22) 32 (132) kl 

('7> 2it (31) ti6 (19) 26 (27) 39 m ]k 
(0) 0 (13) 19 (0) 0 (12) 17 (25) 9 



Nu(i*er responding 
Hissing 


(72) 
(3) 


(67) 
•(6) 


(72) 
(2) 


(65) 
(5) 


(280) 
(16) 


Total 


(75) 


(73) 


m 


(7^) 


(296) 



This response option was not used In the short Interviews. 
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9, On th« whole, did you find that answering the questions was; 
(CIRCLE ONE NUHBER ONLV.) 





Short 
Recall 

(N) % 


Long 
(N) I 


Short 
Retrieval 

(N) I 


Long 
Retrieval 
(N) 5! 


TOTAl 
(N) « 


Very hard 


(1) 1 


(0) 


0 


(0) 0 


(1) 1 


(2) 1 


Hard, 


(2) 3 


Ct) 


6 


(3) h 


(M 6 


(13) ^ 


Easy , , . , 


(53) 72 


(60) 


1)3 


M 67 


(55) 78 


(217) 75 


Very easy 


(13) 2lt 


(8) 


II 


(21) 29 


(li) 16 


(58) 20 


Number responding 

Hissing 


(1) 


(72) 
(1) 




(73) 
(1) 


(71) 
(3) 


(290) 
(6) 


Total 


(75) 


(73) 




(7^) 


(7^) 


(296) 



I 
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Jrihl « J * ^^'V^''l have been asked. For each 

Of he qiifijtlons below, please show whether you feel that (nostMO^le would find the question 




a. Total household Income for 
1979 before taxes: 



Much to'j personal 


. (13) 


18 


(20) 


29 


m 


19 


(20) 


28 


(67) 


2l| 


juniewnat too pOrSOna' , , , 


. (W) 


55 


(30) 


1 t 

kk 


(30) 


112 


(31) 




(131) 




Not too personal 


> (19) 


26 


(181 


26 


\iO) 


iy 


(20) 


2o 


(85) 


30 


Number responding - 
Hissing 


in) 

(3) 




(68) 
(5) 




(72) 
(2) 




(71) 
(3) 




(283) 
(13) 




Total 


(75) 




(73) 




(7lt) 




m 




(236) 




bl, (For Homeowners) Total 






















mortgage payment last month: 






















Much too personal 


(11) 


18 


(10) 


18 


(8) 


15 


(11) 


18 


(ItO) 


18 


Soniewhat too personal . , , . 


(24) 


39 


(22) 


k\ 


(19) 


36 


(27) 




(92) 




Not too personal 


ilk) 




(22) 


k] 


(26) 


^9 


(22) 


37 


(96) 


hi 


Number responding 






(5M 




(53) 




(60) 




(228) 





9,9 



IO" (cofi(lnm»l) 
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Short 
Recoil 


long . 
RflCflll 
(N) « 


Short 
Rotrlevol 


Long 
notrleval 
(N) X 


TOTAL 

IN/ * 


b2. (For Renters) Amount you pnld 
for rent last month: 
















Much too personal 


(0) 0 


(2) 


18 


(0) 0 


(0) 


0 


(2) 5 


SoDewhdt too oersona) .... 


(1) 10 


(!) 


18 


(2) 17 


(3) 


30 


(8) )9 


Not too personal 


(9) 90 


(7) 


6ii 


(10) 83 


(7) 


70 


(33) 77 


Number responding 


(10) 


(II) 




(12) 


(10) 






c, Last utility (electricity, 
gas, or coal) bill: 
















Much too personal ...... 


(1) 1 


(J) 


k 


(0) 0 


(J) 


k 


(7) 2 


Somewhat too personal . . , 


(l'+) 20 


(in 


16 


(6) 9 


(13) 


19 


ikh) 16 


Not too personal, • 


(56) 79 


(55) 


80 


m 91 


(52) 


76 


(227) 82 


Number responding 
Missing 


(71) 


(^9) 




(70) 


(68) 
(6) 




(278) 
(IB) 


Total 


(75) 


(73) 




W 


(7^) 




(296) 


d, Number of complete bathrooms 
and he If bathrooms: 
















Much too personal 


(I) I 


(2) 


3 


(1) I 


(2) 


3 


(6) 2 


Somewhat too personal , , , . 


(6) 9 


(1) 


I 


(I) I 


(5) 


7 


(13) 5 


Not too personal 


(63) 90 


(66) 


96 


(68) 97 


(62) 


90 


^259) 93 


Number responding 
Missing 


(70) 
(5) 


(69) 




(70) 
(It) 


(69) 
(5) 




(278) 
(18) 


Total 


(75) 


(73) 




m 


(7'*) 




(296) 



;>hort 
(N) Z 



Long 
Rficalt 



Short 
Rotrlovol 



long 

X 



«• Nuetar of Mrosnt: 

Huch too ptriu ,il 

SomwiHt too i>«rio.,dl . , , 
Hot too poriontl 

Number rtipondlng 
Hljslng 



TottI 



(•) I 
(6) 8 
m 90 



(2) 3 
(69) 



(I) I 
(I) I 

(70) 

(M 



f, Presence of open cracks or 
holes In the Interior wells 
or celling: 

Much too personal . . , , 

Somewhat too personal . . 

Not too personal 

Number responding 
Missing 

Total 

g. Money received from welfare 
payments or public assis- 
tance; 

Much toe personal 

Somewhat too personal , . . 
Mot too personal 

Number responding 
Missing 

Total 



ERIC 



(18) ^8 
(15) 23 
(32) 49 

(65) 

O0)i 

(75) 



(16) 27 
(19) 32 
(2S) Ii2 

(60) 
(13) 



(10) 18 
(15) 27 
(31) 55 

(56) 
(18) 



(73) 



(20) 31 
(16) 25 
(28) 



TOTAL 
(N) \ 




(1) 1 


(5) 


a 


(3) It 


m 


5 


(66) 9lt 


(J6I) 


93 


(70) 


(2S0) 




(■•) 


(16) 




(7lt) 


(296) 





(3) 


ii 


(1) 1 


(1) 


1 


(2) 


3 


(7) 


2 


(12) 


17 


(6) 9 


(8) 


II 


(12) 


17 


(3B) 


III 


(56) 


79 


(62) 90 


(61) 


87 


(56) 


80 


(235) 




(71) 






(70) 




(70) 




(280) 




(M 




(M 


(<•) 




(M 




(16) 




(75) 




(73) 


m 




m 




(296) 





m 26 

(65) 26 

(116) 1.7 

(2'«5) 
(51) 

(296) 



Now, p\mt look <it those um Iteini flijflln, Thli tliiKi, ihow whpthdr yoii t'ftel thM moat ppoj^lff 
wouH find the qimatton vrry hrtnl, soinewhftt hflpd, or urtsy tn flniwer, (CIRCU ONLY ONE NUMBER 

m m oussTioN,) — 





Short 
RpcnII 
(N) % 


Long 
Recn 1 1 

W % 


Short 
Retrieval 
(N) % 


Lon<] 
Retrieval 

(N) I 


(N) X 


a. Total househotcl Incomo for 
1979 before t(\m\ 




















very nflTd to nnswor , , , ♦ , 


(3) 


ii 


(5) 


8 


(6) 


8 


(15) 


21 


(29) 10 


Somcwhrtr Iwrd to nnswer , , , 


(33) 


li8 


(30) 




(19) 


27 


(26) 


2/ 


(108) 39 


EflSv to onswcT- . . 


(33) 


Ii8 


(32) 




('*6) 


65 


(3^) 


'12 


i 1 M 1 j *; 1 


Number respond! nt] 
HI$]lr)(] 


(69) 
(6) 




(67) 
(6) 




(70 
(3) 




(71) 
(3) 




(278) 

\ 10/ 


Tnf 1 1 
1 OlOl 


(75) 




(73) 




(7'0 




(7M 




(296) 


bl. (For Homeowners) Total 
mortgage piiyniont last month; 




















Very htird to answer 


(2) 


!♦ 


(2) 


k 


(3) 


6 


(10) 


17 


(17) 8 


Somewhat hard to answer , . , 


(13) 


23 


(7) 


13 


(6) 


II 


(10) 


17 


(36) 16 


Easy to answer 


(^^2) 


7^* 


(^6) 


30 


(1*6) 




m 


67 


(17^*) 77 


Number responding 


(57) 




(55) 




(55) 




(60) 




(227) 



b2. (For Renters) Amount you 
paid for rent last month; 



Very hard to answer 


(0) 


0 


(1) 


9 


(0) 


0 


(0) 


0 


(1) 


2 


Somewhat hard to answer , , , 


(2) 


18 


(0) 


0 


(1) 


8 


(1) 


!0 


(«♦) 


9 


Easy to answer 


(9) 


82 


(in) 


91 


(II) 


92 


(9) 


90 


(39) 


89 


g|^(^lumber responding 


(II) 




*Nii) 


m 


(12) 




(10) 









c, Ult uHMty (olflctrlclty, 
Qa«, or cmI) bill; 

Very hnrd to flnjw«r 

Somewhat li(ird to aniwer . , , 

Efljy to flniwer 



Shof 
(N) t 



Long 
(H) % 



Short 
Hotrlevot 
(N) X 



long 
l^ocrlevil 

(N) X 



MuDbor respond I nq 
Hl$5lng 



(I) 2 

(i;) 22 

(52) 76 

(68) 
(7) 



(I) I 

(18) 26 

(50) 72 



(17) 

(71) 
(J) 



I 

75 



(5) 7 
(21) 30 
m 62 

(69) 
(5) 
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TOTAl 

(N) ! 



(8) J 
(71) 26 
(198) 72 

m 

(19) 



Tntfll 






(73) 




(7'i) 




m 




(296) 




Nunber of complete b«thro(,vTi! 






















flno nfli f oatnToonis: 






















Very hard to aniwor 


(0) 


0 


(1) 


2 


(0) 


0 


(1) 


1 


(2) 


1 


ju'Mownai naro lo answer , , , 


(1) 


2 


(2) 


3 


(2) 


3 


(2) 


3 


(7) 


2 


Easy to answer. , 


(67) 


98 


(65) 




(69) 


97 


(00) 




(267) 


97 


Number responding 
MIsstng 


(68) 
(7) 




(68) 
(5) 




(71) 
(3) 




(69) 
(5) 




(276) 
(20) 




Total 


(75) 




(73) 




(71.) 




(71*) 




(296) 




Number of bedrooms: 






















Very hard to answer 


(0) 


0 


(1) 


1 


(0) 


0 


(1) 


1 


(2) 


1 


Somewhat hare' to an-iwer . , , 


(1) 


2 


(3) 




(0) 


0 


(2) 


3 


(6) 


2 


Easy to answer 


(66) 


98 


(65) 


9'* 


(71) 100 


(66) 


96 


(268) 


97 


Number responding 
Mfsslng 


(67) 
(8) 




(69) 
{^) 




(71) 
(3) 




(69) 
(5) 




(276) 
(20) 




Total 


(75) 




(73) 




m 




(71.) 




(?Q^: 





il "lgpntlDuad) 





Short 
Recotl 


long 
(N) % 


Short 
Hotrlevfll 

(N) % 


lofi9 
lletrtevil 
(N) % 


TOtAL 
(H) % 


f, Prownce of open cncki or 
holes In the Interior wiilh 
or celling! ' 


















Very hard to Answer 


(1) 2 


(3) 


5 


(0) 


0 


(1) 


? 


CO 2 


SoflHswhat hflrd to nnswor , , , 


(6) 9 


(9) 


I'l 


(Ifl) 


I'l 


(12) 


18 


(37) l'» 


Eflsy to Answer 


(61) 90 


(53) 


82 


(60) 


86 


(55) 


81 


(229) 


Number roipondinq 


(68) 
(7) 


(65) 
(B) 




(70) 
(M 




(68) 
(6) 




(271) 
(25) 


lOlol 


\ni 


(73) 




(7'0 






(296) 


g. Money recfltved from wo 1 fere 
peyments or public {issts- 
tance: 


















Very hard to answer 


(M 6 




7 


(5) 


8 


(9) 


\k 


(22) 9 


Soitiewhfl' hard to nnswor , , , 


(8) 13 


(13) 


22 


(8) 


13 


(I'O 


23 


(^♦3) IB 


Easy to tinswor 


(50) 81 


(^^3) 


7? 


('♦8) 


79 


(39) 


63 


(180) 7it 


NuKjr responding 
MIsf.Ing 


(62) 
(13) 


(60) 
(13) 




(6)) 
(13) 




(62) 
(12) 




(2'*5) 
(51) 


Total 


(75) 


(73) 








(7M 


(296) 



ll 
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VOM wtrt aiktd to ttll ui th« ^mounti of iom« of your utility bltU And houifthiilH .M»«n... 
Mow aimftUt do yoii fMl your .niwr. wr«? (CIRCU ONg NUHm ONLv!) ^^""^^'^ •«r>«ni«i. 



Short 
Nc« 1 1 

(N) % 



Probably vtry accur^tt. , 
Probably fairly accurate. 
Probably Inaccurate , , , 

Number responding 
Hliaing 

Total 



lon*5 

n#CAll 

(N) % 



Short 
l^etrleval 

(N) % 



long 
Retrieval 

(N) X 



TOTAL 
(N) X 



('•a) 


67 


(37) 


55 


(51) 


72 


(50) 


72 


(186) 67 


(23) 


31 


(19) 


'♦3 


(20) 


28 


(19) 


28 


(91) 33 


(1) 


1 


(1) 


2 


(0) 


0 


(0) 


0 


(2) 1 


(71) 
(3) 




(67) 

(6) 




(71) 
(3) 




(69) 
(5) 




(279) 
(17) 


(75) 




(73) 








(7'0 




(296) 



10- 



J, Ovimll, do yog f«#l thut th» \\m jinrt #ffort yog put \m mmr\^ th» (iwPMlon* wai! 
(£HCU ^ NUHSII OHIV,) 





$hert 

fiflCflll 

(N) : 


Long 
ll«c«ll 

(M) K 


Short 
K(itrl«v»l 

(N) X 


Long 
Hotrlovil 

(N) 


TOTAL 

(») X 


Viry wll ip«nt 


(27) 37 


(19) 77 


(n) 28 


(20) 28 


IfK) )0 


So^hAt woll ip«nt 


M 59 


m 59 


('♦7) 66 


M 58 


m do 


Not vtry woll tpint ....... 


(3) 


(10) 1'* 


(M 6 


(10) Ii» 


(27) 10 


Nufflbir rii ponding 
Hilling 


(73) 
(2) 


(70) 
(3) 


(71) 
(3) 


(71) 
(3) 


(285) 

(M) 


Total 


(75) 


(73) 


m 


(7'*) 





* 
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(fM TAU rvr THt HMM 9^1 f»»f IWI-I fMiOW«i: lO-MNICH Iflf ^11111111 nJii, iw^H THnHi W|C«M v|u ! ' 



«| AM 







to 


1 u 




10 


MlfUy*t 
T to 


f 10 




C«tff 






I.M 






t.40 


t.4t 


t.tt 




Ml 


1.77 




(110) 






fllMl^ •Ml Im«mi IM fl»f*t . . 






4.0) 


).4I 


4. Ml 




4.04 




4.1} 




m) 


(tl) 








).oo 




).0) 




l.oa 




Ml 


4.14 


).»0 


(HI) 


(19) 


tf, 




^J? 






J. IT 




).40 


$.11 


M9 


4.f) 


r>9 


(IM) 


(tn 


«« 


Aolftf !• |h« |« •«« 


1.19 






t.ts 




M7 


I.t4 


t.M 


t.4l 


I»I7 


(IH) 


(It) 


f. 




^.11 


).S9 








).)t 


S.lt 


).?l 


V4| 




(t4M 


(19) 



107 





(H| t 




(Ml t 


(N| t 


(H) H 


^fl t 1 I t « 1 t t « 1 1 1 « 1 1 








m n 




A lAliltfllit-llll 


(10) 




(HI II 


(?o) r} 






(?0 

{^1 (M 


(M) 
lit 


CO) 
('•) 


m) 






(/J) 


m 
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16, We have had a number of suggestions about ways in which our surveys could be improved How do 
you feel about each of these? (CIRCLE EITHER "0" OR "1" FOR EACH SUGGESTION.) 





Short 
Recall 
(N) % 


Long 
Recall 


Short 
Retrieval 
(N) i! 


Long 
Retrtevsl 

(N) 5! 


TOTAL 

(II) X 


a. 


Set up appointinents for 
interviews: > 




















Would be an improvement . . . 




(53) 77 


(55) 


81 


(58) 


87 


(218) 


80 




Would not be an improvement . 


(18) 26 


(16) 23 


(13) 


19 


(9) 


13 


(56) 


20 




Number responding 
Missing 


(70) 
(5) 


m 


(68) 
(6) 




(67) 
(7) 




(27I1) 
(22) 






Total 


(75) 


(73) 


(7".) 




m 




(296) 




b. 


Explain more about how the 
answers will be used: 




















Would be an Improvement . . . 


(57) 83 


(49) 71 


m 


70 


(5M 


82 


(206) 


76 




Would not be an Improvement . 


(12) 17 


(20) 29 


(21) 


30 


(12) 


18 


(65) 


2lt 




Number responding 
Missing 


(69) 
(6) 


(69) 
(M 


(69) 
(5) 




(66) 
(8) 




(273) 
(23) 






Total" 


(75) 


(73) 


(7't) 




(71.) 




(296) 





10.9 



l6-*(continued) 



Short 
Recall 
(N) I 



Long 
Recall 

(« % 



Short 
Retrieval 

I 



Long 
Retrieval 
(N) X 



c. Explain more about how the 
confidentiality of the 
answers is protected; 



TOTAL 
(N) % 



Would be an improvement . . . 


(39) 


57 


^^3) 


63 


{^5) 


66 




63 


(170) 


62 


Would not be imorovement. . . 


(29) 




(25) 


37 


(23) 


3"! 


(25) 


37 


(102) 


38 


Number responding 
Missing 


(68) 
(7) 




(68) 
(5) 




(68) 
(6) 




(68) 
(6) 




(272) 
(24 




Total 


(75) 




(73) 




(74 




(7^*) 




(296) 




d, Hire better interviewers: 






















Would be an Improvement . , . 


(5) 


8 


C") 


6 


(M 


6 


(9) 


\k 


(22) 


8 


Would not be an Improvement . 


(61) 


92 


(61) 


Sh 


m 




(55) 


86 


(2'*1) 


92 


Number responding 
Missing 


(66) 
(9) 




(65) 
(8) 




(68) 
(6) 




m 

(10) 




(263) 
(33) 




Total 


(75) 




(73) 




(7M 




W 




(296) 




e, Use shorter questionnaires: 






















Would be an improvement . . . 


ill) 


33 


(38) 


57 




35 


(38) 


57 


(122) 


it5 


Would not be an Improvement , 




67 


(29) 


43 


m 


65 


(29) 




im 


55 


Number responding 
Missing 


(66) 
(9) 




(67) 
(6) 


m 


(69) 
(5) 




(67) 
(7). 




(269) 
(27) 




Total 


(75) 




(73) 




(74) 




m 




(296) 
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^"•(contfnugd 



Short 
Recall 
(N) 



Long 
Recal] 

(N) % 



Short 
Retrieval 



/o 



Long 
Retrieval 

(N) % 



TOTAL 
(N) % 



U Ask fewer personal questions: 






















Would be an Improvement . . . 




35 


(22) 


33 


(21) 


31 


(3M 




(101) 


37 


Would not be 3n tinnrnu(>rTiPnt' 








0/ 


(46) 


69 


(35) 


51 


(I69) 


63 


Number responding 
Missing 


(68) 
(7) 




(66) 
(7) 




(67) 
(7) 




(69) 
(5) 




(270) 




Total 


(75) 




(73) 




(7".) 




m 




(290) 




g. Give respondents more chance 
to talk about their Ideas 
and opinions: 






















Would be an Improvement , , . 


(30) 


^5 


(25) 


10 




35 


(22) 


3it 


(101) 


38 


Would not be an improvement . 


(37) 


55 


(38) 


lit 


m 


65 


(^2) 


66 


(161) 


62 


number responding 
./Hissing 


(67) 
(8) 




(63) 
(10) 




(68) 
(6) 




m 

(10) 




(262) 

m 




Total 


(75) 




(73) 




(71*) 




m 




(296) 





111. 



APPENDIX C 

PERCENT OF RESPONDENTS CHECKING RECORDS 
FOR VARIOUS EXPENDITURE ITEMS, 
BY INTERVIEW EFFORT AND TREATMENT 




Effort 



Treatment 



Item 


Recall 


Retrieval 


Short 


Long 


Short 


Long 








Reca 1 1 


rvcLd 1 1 


Retrieval 


Ketrieval 




(Base 


X 


(Base „ 
N) 


(Base „ 
N) ^ 


(Base 
N) * 


(Base 
N) 


' % 


(Base „ 

N) ^' 


Rent Payment 


(79) 


1 




(33) 


3 


{hi) 0 


(19) 


26 


(22) 4 


Premium for Renters Policy. 


(3^^) 


9 


( 12) i*8 


(18) 


11 


( 16) 6 


( 5) 


40 


( 7)50 


Mortgage Payment 


(102) 


13 


( 53) 39 


(^♦9) 


]k 


(53) 11 


(29) 


31 


( 24) 50 


Premium for Home Insurance. 


m 


18 


( 73) 29 


(80) 


17 


( 8if) 19 


(39) 


23 


( 34) 35 


Water Bill 


(116) 


27 


( '♦9) hi 




a 

m 


(116) 27 




a 


( 49) 43 


Oil Bin, Gas ?!1I 


(236) 


36 


( 95) 57 


(in) 




(125) 32 


(^♦3) 


49 


( 52) 63 


Trash Bill 


(73) 


]k 


( 28) 21 


(21) 


]k 


( 52) ]k 


( 6) 


17 


( 22) 23 


Car Insurance Premium . . , 


(200) 


8 


( 85) 35 


(106) 


11 


iSh) 5 




38 


( 40) 32 


Auto Registration Fee . . . 


(238) 


10 


( 92) 30 


(125) 


]k 


(113) 6 


ihS) 


33 


( 43) 28 


Electric Bill Last Honth. . 


(315) 


33 


(139) 50 


(160) 


Ik 


(155) 32 


(70) 


41 


( 69) 58 


Electric Bill: Honth 2 . . 


(313) 


2? 


(137) 52 


(159) 


28 


{\Sh) 29 


(70) 


43 


( 67) 61 


Electric Bill: Honth 3 . . 


(313) 


26 


(136) k(> 


(159) 


26 


m 26 


(70) 


36 


( 66) 56 


Phone Bill: last Honth . . 


(323) 


23 


m kS 


(156) 


23 


(167) 23 


(69) 


40 


( 71) 50 


Phone Bill: Honth 2. . , . 


(319) 


19 


(142) itO 


(158) 


18 


(161) 20 


(69) 


35 


( 73) 44 


Phone Bill: Honth 3. . , . 


W 


18 


m 35 


(157) 


15 


(157) 20 


(68) 


30 


( 73) 40 



'Question not asked In short interview. 
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